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ABSTRACT 

An outcome of a study of adult basic education 
programs initiated three years ago by the Columbia University Center 
of Adult Education, the evaluation guide with its step^-by-step 
instructions can be used for both formative and summative evaluations 
of adult basic education programs. Background research involved in 
this pubrication included direct field experience, with over UO local 
adult basic education operations. One section is related to the "how" 
of evaluating a program and includes coverage of type of approach, 
preparing initial and detailed plans, making a preliminary survey, 
collecting data, and analyzing and interpreting data. The section on 
"what" to evaluate is related to recruitment, staffing, inservice 
education, instruction, collaboration, and goal-setting. 
Approximately 80 pages are devoted to the sample instruments 
(interview guides, questionnaires, and forms) needed to collect 
evaluation data. The appendixes include an annotated bibliography on 
evaluation methods, external standards information for evaluation 
interpretation, and adaptation for ABE/Model Cities joint programs. 
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FOREWORD 



Three years ago the Ccntcrjor Adult Education initialed a study of adult basic education programs. To formulate a 
dependable fra me of. reference for docision m akin g _ab o u LLllc .dey e [o pment of those p ro gra m s, _ th c_Ce njer ; acquj rcd_ 
direct field experience- with over 40 local adult basic education operations. This publication is a product of that study 
and is best understood in the perspective of its history. ^ . . ^" 

The work began with a comparative study of unprecedented scope to identify (i) the common practices and 
problems in ABE program organization and admlnistration;-(2)>the evolyirig processes of interaction among students, 
faculty, and administrators, which explain the ways of program practice; and:(3) the perspectives of each group to see 
the whys of interaction through participants' own eyes. A team from Columbia conducted over 100 interviews of ono 
to two hours each with program administrators and staffs in six cities across^the United States. Participantobservcrs 
operating from four universities were attached to a stratified sample of 59 classes in five cities over an eight-month 
period. From their 237 field reports and interview data, significant patterns of program practice, social interaction, and 
perspectives were identified. 

Findings were tested against the experience of six leading urban ABE directors in a group consultation. Two national 
surveys, one of urban directors and the other of more than 1,000 ABE teachers, and a series of four regional workshops 
involving 200 directors and professors of adult education were conducted to establish the general validity of findings 
and to provide a needed set of norms on national urban program practice. Policy issues, major problems, and innovative 
practices were identified, priorities for research and demonstration suggested, staff development needs clarified, and 
benchmarks for program evaluation established. The methodology, "synchronic induction," used to construct this 
multi-dimensional normative description and analysis of urban ABE practice constitutes a new development in social 
research with broad applicability for program analysis. 

A second phase of the Center's work sought insight into organizational, programmatic and interactional factors 
which impede or facilitate the development of innovative program practices within ABE. Four ''grounded theory" 
studies were undertaken, each, using, comparative field methods to analyze one or two selected practices- in six cities. 
The purpose was to provide guidelines. to planners. The same four collaborating universities undertook these studies. 
Selected program practices analyzed included: use of paid aides and volunteers in the classroom, classes co-sponsoi^d 
with employers, decentralized classes, learning laboratories, the use of full-time teachers, centralized programs, and the 
use of community liaison personnel. Findings from our first two years of study will be reported in a book authored by 
Gordon Darken wald, Alan Knox and nriyself. Last Gamble on Education^ to be published in 1974. 

A third development within the Center has focused upon training systems for ABE. Professor Winthrop Adkins has 
produced a set of teacher-training packages involving lesson plans and supporting multi-media materials, including 
videotapes, for- teacher training in areas identified by our studies as important. After two years of pilot effort .the "Life 
Skills" project has been separately funded as a continuing experimental effort. 

An overriding concern governing our work with ABE has been to better understand and predict its evolving reality 
without arbitrarily fragmenting.it. This was a major reason why we chose inductive field methods and devised ways to 
apply them to a comparative analysis of national scope. Our work has focused on the qualitative, the interaction within 
the classroom, the program, and the organization. 

When we approached the fourth phase of work, development of a guide for program evaluation, we sought a way to 
help the evaluator grasp this qualitative reality as benchmarks for assessing program progress. We chose to adapt an 
approach suggested by the work of Robert Stake, of the University of Illinois. 

Based upon our compilation of a "critical decisions inventory" of major policy and program questions confronting 
ABE directors, we identified six areas as crucial: staffing, instruction, recruitment, collaboration, in-service education 
and goal formulation. In each area the approach is one of determining the degree and nature of the fit between intent as 
currently defined by those locally involved and current practice. To describe intent, detailed guides are presented for 
interviewing administrators and supervisors, and questionnaires are included for teachers and participants. Current 
practice is ascertained fthrough questionnaires developed for administrators, teachers, students and co-sponsors, as well 
as classroom observation rating forms. ' 

While examining incongruities between intent and reported practice, this approach also systematically examines 
qualitative differences in program expectations among administrators and supervisors, among teachers, among 
participants and between these groups. 

The interview guides, questionnaires, rating scales, observation guides and other instruments are meant to be 
nnodified by the user. Items can be deleted, rephrased or added* to fit local conditions. Directors may choose to use only 
two or three of the six areas for which instruments have been developed, depending upon their current need and 
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inlcrcsl. The instruments can simply be pholocopied directly from this guide. ' 

The approach can be used for a formative evaluation, to provide feedback useful for improving program practice. It 
can also be used for summative evaluation by a follow-up study to determine the degree to which earlier reported 
discrepancies have been overcome. 

The Center's approach to evaluation constitutes a recognition that there is much more involved in assessing ABE 
than quantitative indicators- alone, although these are important and included. It accommodates the fact thai as 
programs evolve, operational objectives must be tested against reality and modified accordingly, and that practices and 
priorities change as programs mature: Our intent has been to provide the director and his staff with the means to 
identify how their local program is or is not meeting their own expectations and to better understand the reasons for 
unsatisfactory progress. When it becomes desirable to use an external evaluator, the approach we suggest retains for the 
director and his staff control over the objectives and methodology of the evaluation. 

Gordon Darkenwald served as Associate Director of the Center's evaluaion project, Harold Beder as its Assistant 
Director. Garrett Murphy, Director, Adult Learning Center, Albany, and Richard F. Kelley, ABE Director, Hartford, 
were consuUants, and their staffs gave us invaluable advice. Several consultants reviewed our work: Curtis Sederburg, 
Supervisor, Adult Continuing Education, Lincoln Nebraska Technical Community College; Payton S. Hutchinson, 
Administrative Assistant, Continuing Education, Evening and Summer Schools, Detroit Public Schools; John Hatfield, 
Project Director, Region V, ABE Staff Development Project; Jean Bailey, Danville junior College, Danville, I llinois, and 
Charles E. Kozoll, Department of Adult Education, University of Georgia. Charles Mingus provided major editorial 
assistance. Mary Morris helped with the editing of an early draft. The cover design was by Karla Xaynee. 

. X 



Jack Mczirow 
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Part 



WHY EVALUATE YOUR PROGRAM? 



Most adminisiraiors and leichcrs in aduU basic education (ABE) arc well aware that th<5y are pioneers in an undertaking 
of-major-soeial-valueMhe-mb-of-hclping-undcreducated-adults-extend the! 

and more rewarding life. These administrators. and teachers, therefore, strongly want, to improve their ABE programs. 
Bui, lo improve something, v|ou need lo understand its strengths and weaknesses. This i| where evaluavion comes in. 

Ju>i about ovorypnc assoiiiat'od with adult basic education makes informal judgmeijits about program effectiveness. 
An adull student who roads lU the lourtlvgradc Icvcl.judgcs the program when he dfops out because it is not helping 
him gel a job. A part-time' tca\:her judges the program when she decides to use different materials to teach arithmetic/ A 
member ol" the local school bnard judges the program when he approves its annual allocation of funds Irom the school 
budget. And an advisory contmittce member judges the program when he compares current activities with desirable 
directions. Each one of these p\;ople is making an informal evaluation. 

Formal evaluation also take\i place. Most ABE programs report results of periodic achievement testing to the state 
education department. Most dilectors monitor enrollment and attendance rates as indications of program success. But 
ABE staff members are often\ skeptical of formal evaluation procedures, because these are typically designed for 
elementary and secondary schi)ol programs and frequently have' little utility in assessing programs of adult basic 

educations. • 1 

Formal evaluation can, howd^cr, benefit programs in several ways. One benefit is simply that someone is considering 

iluation questions are being asked. Another is the greater likelihood that evaluative 
uate information. A third benefit is that persons in a position to improve the program 
e evaluative judgments and to be committed to using them. 

eve these benefits of formal evaluation while attempting to preserve the flexibility and 



whether, the most important ev 
judgments will be based on ade( 
are more .likely to know about l\ 
This guide is designed to ach 



United Stales and is presented in 
Typically, most persons assoc 
evaluative judgments. The guide 
increased. First, the guide can h 



adaptability of informal evaluatpn. The material is based on the analysis of urban ABE programs operating across the 



a form that can be readily adapted to local needs and circumstances, 
ated with ABE arcstrongly committed to program improvement and continually make 
uggests three ways m which the usefulness of this continuing evaluation process can be 
^Ip to focus evaluation activities on those parts of the program that are most likely to 
be improved through evaluation. Second, the guide can help staff members to collect relevant data so that they will 



have greater confidence in the e 
the evaluation activity in a way 



v^aluative judgments that are made. Finally, the guide can help staff members conduct 
ihat is more apt to result in program improvement. 
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Part 1 1 



HOW TO EVALUATE YOUR PROGRAM 



This, part o f the gui de do scrihcN a iypiL\ii plan of aciion ancV-iluaiur mi^hl luiluw in preparing lor and .conduciing a f"" 
program cvadiation. Actual cvadiaiion plans \vi(( vaiy rrt)nTTFhrtTn»rTi7"Ft^^ 



taken. For example, the cvaluaior might iu* the ABll director, amembcr o( his stall' serving as chairman of the 
evaluation committee, or an outside evaluation consultant. The series oi' steps might cover niost of the* activities 
suggested in the guide for each component of the program' or might be restricted to a few activities for a single 
component that appears in special need of evaluation.. 

Copie!i of ihe plan should be used to orient siall' members \^!ho will be affected by the evaluation effort. Early in the 
preparation st.ige, the evaluator might make an audio-visual presentation based on the following material. A discussion 
following the presentation would help clarify objectives, procedures, and roles, as well as reduce apprehension and 
increase commitment to the evaluation effort. 

^ - . 

Decide on the Approach 

Over the year^ there have been many approaches to educational evaluation. The most prominent approach has been' 
achievement testing. Almost all approaches to evaluation h;ive included the making of judgments based on evidence'or * 
data. But beyond that, there have been important differences. 

Some approaches have emphasized the role of impartial external cvaluators. Others have stressed continuous 
cva luatioii byjs uUl ha^'c emphasi;^ed a combination of interna} and external evaluation. Approaches 
also vary in the. aspects of th^^ program on which' evaluation activity is focused. The traditioiial focus of educational 
evaluation in the schools lias been on testing of student achievement as exemplified by multiple-choice exams. By 
contrast, adult education programs hove focused on applicaton of what is learned (especially for work-related 
.programs), student satisfaction (end-of-program reaction forn^isji and.pcrsistence rates (agency, records pri attendance 
and dropouts). Evaluation approaches vary, too, in ihe sources from which data arc obtained— teachers, students, 
administrators, other staff members, persons in related ocgivnix.ations, and ABE rccoids. There are also variations in who 
does the judgi/]g and how judgments are used. 

This guide is organized around the ^dea of evaluating ABE programs by comparing intended practice with actual 
(current) practice. This helps idenirlV gaps to be closed by prui^ram improvemenis. The guide divides an ABE program 
into its major pans (components) and for each part lists items that might be evaluated. Items can be added, deleted, or 
modified to meet the needs of .m indivitlual program. The guide can be used both for internal evaluation (with its 
advantages of familiarity and commitment to use results) and for external evaluation (stronger on impartiality and 
awareness of outside resources and standards). When usetl for external evaluation, it provides the local ABE' director 
with a degree of control over objcctiv.es and methods. 

The approach of this guide, ol course, represents only oiu* way of thinking about evaluation; Other approaches arc 
desn ibed jji ilie references lisied In Appendix A. Some of these approaches, such as those of Knox (1969, 1971) and 
Stake (1967). ,ue similar to the one describetl here. Others provide contrasting viewpoints; for example, those ol'Tylcr 
(1950). Bloom (1971), Qjfey (1953), Suchn7<m (1967). and Scriven (1967). If a local evaluation committee decides" 
th.ii an approach diiteient frcMn the one described here is best lor their purposes, they can still adapt some of the 
procedures and instruments contained in this guide. The literature on fuethods (jI evaluation describes procedures for 
data collection such as consulting records, oh^el•ving activities o.*' maleri<ils, testing, administering questionnaires, and 
conductinggroup<itid individu.il interviews. 

There are four parts to the guide. The first part briefly discusses the reasons lor evaluating ABE programs. The 
second part, which includes this section, tells how to evaluate a program fiom start to finish. The third part discusses 
six major components of AGE programs -recruitment, staffing, in-service education, instruction, collaboration, and goal 
setting -and lists the items that might he evaluated forcach component. The fourth part contains the instruments to be 
used in gathering the evaluation data— interview guides, questionnaires, and forms. These instruments contain the same 
evaluation items as the componcnls, but in the instruments these items are rephrased usLially as questions and are 
rearranged in "groups according to the sources of the data and methods of data collection. Thus, one instrument, the 
Adminisiraiive.^t'aff Interview Guide, contains items from all of the components. Each item is cross-referenced so that 
the corresponding item in the components or in the instruments is easily located. 
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Organize the Effort 



" There is a big advantage in having your ABE unit do its own evaluation rather than leaving ^.he job to outsiders. When- 

staff members take part in an evaluation effort, they are much more inclined to accept the resulting recommendations 
arj^e lp implcMTie.nt the m. In aildit ion, those who participate tend to become more competent in the use of evaluation 

"^"^ pi o c e d Lire sTl h cse benefits are more likely to be achieved il' the following suggestions arc followed: 

(1) Keep persons associated wiih the-ABE unit informed about the evaluation activity throughout the effort/ 

(2) Make sure the evaluation committee represents all groups associated with the unit. 

• (3) Provide funds in the ABE budget for basic evaluation expenses, including an evaluation consultant. 

•(^1) Make one person chic fly .responsible for leading the evaluation effort and give that person the time, resources, 
and recognition necessary tu do the job. 

(5) Recognize and encourage those who help with the effort. ! 

(6) i^M'iodically review the effort so that it stays on target. ; 

• (7) Plan to use the results of evaluation to improve the program. 

Th(jse who organize the internal evaluation activities have a dual respansibility. First, they must plan and conduct the 
evaluation activities in such a way that the appropriate data are collected and analyzed. Second, they must proceed in a 
way that encourages people associated with ihc'ABE unit to Ui^e the evaluation results to improve the program. One of 
the best ways to meet these responsilii lilies is to include persoijs associated with the ABE unit in the planning and 

Bs;rn^.«.««A, carrying out of the evaluation effort. Thus, even jLonc person performs most of the planning and administrative tasks 
of., the evaluator role, it is helpful to have an evaluation advisory committee to facilitate communication and 
coordination. I 

ScIccl the members of an evaluation committee with care. The /committee should be small enough to be. manageable, 

bui large enough to .be rcpresentative./fhree .to eight members are about right. These persons should have the basic 

competencies needed for a successful evaluation effort. It is helpful if the committee includes the director or one of the 
major program administrators or supervisors, at least one or two teachers, and perhaps a student, support staff member 
such as an aide or counselor, and even a representative of a co-s'ponsor. One or two members, preferably more, sliould 
be fairly knowledgeable about educational evaluation. A chairman who is a strong leader can greatly increase the 
(jffectiveness of the committee.^ 

The chairman should give special attcniion to scheduling. He should make up a timetable of major activities, with 
target dates for the completion of major phases. The committee can then review the proposed timet al^le for feasibility, 
encourage people to cooperate with the evaluation effort, urge them to complete evaluation tasks adequately and on 
lime, and arrange for reporting of results. • , . - 

J 

Prepare an Initial Plan ^ 

The basic evaluation plan should be dcvclopcclMn advance. When evaluation activities arc restricted to two people or a 
sitigle classroom, a ()!an can he Liuitc informal. Bui wlien various stafT nicmbers pai ticipaie, as in the jppi'o.ich of this 

guide, a moro formali/e^plan is recommondecL - 

An early decision will have to be made on the extent of the evaluation effort. This must necessarily be a compromise 
between what is desirable and what is feasible. Try to idcnlify indicators of how well the ABE unit is functioning and 
how successful it is. Also, identify current evaluation procedures. This early exploration should lead to conclusions' 
about the extent and type of evaluation effort that seems needed. Of course, the need for evaluation has to be weighed 
against the amount of lime and money available for it. Conclusions about the amount of resources to be allocated to 

; evaluation will depend on what has been done in tlfc recent past and what the anticipated return on the investment will 

' be. • ■ ' 

As the planning and the conducting of the evaluation proceeds, there will be further points at which it will be useful 
lo consider the balance between costs and benefits. The benefits to the program obviously should exceed the costs of 
evaluation. Qjic function of the evaluation committee or an individual evaluator is to maintain a favorable balance 
between costs and benefits. 
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In preparing a basic evaluation plan, give aitcntion to each oC the (oilowing questions: 

(1) How might the recent history of ihe ABE unit aiicct the evaluation olTort? 

a. Is the unit struggling to gel started, rolling along smoothly, or experienciiig major problems? 

b. Is a high rale of staff turnover likely lo affoci ihe operation of lhFXBE"TynTtlinJ/67an 

c. Will past experience with evaluation influence current attitudes f.oward it? 

(2) Can already available data lie used for evaluation? 

a. How pertinent and accur«ile arc the data? • 

b. How representative are the data and what biases should be guarded against? 

c. What problems are likely to be associated with using this data for evaluation? 

(3) How experienced in working with evaluation procedures are persons associated with the ABE unit? 

a. What cofnpcl.encies cun be counted on? 

b. What problems assnciatcd with inexperience should be guarded against? 

c. How apprehensive are people likely to be? 

d. What might be done to prepare the way for an evaluation effort? 

(4) What aspects of the ABE unit and program should be especially noted so that they are not overlooked during 
the evaluation process? 

a. Arc there points of m ajqr^ r passing emphasis, such as personnel changes or a new location, that should be 
understood as part of thWfirrenl program rationale? 

b. Are some parts of ihe^^program, such as relations with co-sponsors, especially susceptible to damage unless the 
evaluation activity is carefully conducted? / 

(5) Does available evidence suggest that certain components of the ABE unit should be the focus of the evaluation 
effort? 

a. Are there ma)or problems that evaluation might help solve? 

b. Are there satisfactory silualions that could be substantially improved by changes brought about by 
evaluation? 

(6) On what b.wis should the evaluation effort be focused on selected aspects of the ABE unit? 

a. Would a-'small. evaluation effort devoted to each aspect of the ABE program be likely lo produce the greatest 
overall benefits? 

b. Should some of the evaluation effort be used to identify the points at which the remainder should be 
Concentrated? 

c. How should it be decided on wlrai aspects of the program to locus evaluation? 

(7) What is the scope and extent of the evaUiaiion effort that seems warranted at the present time? 

a. What resources are available? 

b. How large are the probable benefits of evaluation? 

c. What negative results are likely? 

(8) Who shoLild lake pan in ihe planning of the evaluation effort so thai ii will be effective? 

(9) ^^nid ccnain people be included in the evaluation process to increase the chances that they will use the results? 

Several" persons associated with the ABE unit should discuss these and other periineni questions and recommend a 
planning procedure for the evaluation effort. 
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Make a Preliminary Survey 



The purpose of a preliminary survey is lo help the evaluaiion committee decide what aspects of the program should be 
the locus of the main evaluation cITorl. This decision will, enable the commiltee to invest available resources'ai ihe 
points where evaluation is likely to result in the greatest program improvement. The preliminary survey is lo the 

cvaluaiioh-effori-what-a-pilot-project-is-tO'a-rcsearch-sludy. " 

. ..A Preliminary Survey Guide is included in the section on Evaluation histrumenis as the first of three itilerview- 
guides. Most of the evaluation items in the Preliminary Survey Guide parallel the items grouped under Ihe major 
program components in the section on What lo Evaluate. Thus, the Guide includes items on recruitment, staffing, 
in-service education, instruction, collaboration, and goal setting. In addiion, there area few items (78 though 84) lhal 
deal vvilh oiher components. . ^ 

Tile following are typical steps toward a preliminary survey. Each loc:ii ABE unit will want to prepare a similar plan; 
lh»it best fits its own circumstances. ! 

(1) Prepare Plan -- Review the local circumstances and prepare a plan for the preliminary survey. ! 

V a. Assign Responsibility — The local ABE director or whoever else has overall responsibility for program 
evaluation should designate 'ai;^evalualor oi a committee as having primary responsibility for planning and 
Conducting the preliminary jsurvey. The evaluator or chairman of an evaluation commiltee might be ihe 
director himself, but preferably would be another staff administrator or an outside consultant. Throughoui 
the remainder of this set of [procedures, the person with primary responsibility for the preliminary survey will 
be referred to as the Chairman of the Evaluation Committee. 

b. " Clarify Purpose — Ihe Chairman should recognize that the primary purpose of the preliminary survey is to 

help determine the locus o)* the main evaluation effort. This focus is important if the effort spent is lo 
produce the greatest improvement in the program. The findings from the preliminary survey can supplement 
the best estimates of peoplejfamiliar with the local ABE program. 

c. Conduct Initial Review - A brief, informal review of existing information can supplement the preliminary 

survey or in some cases be a substitute for it. The review might include reading past evaluation reports; 
reviewing records that relate to evaluation (e.g., achievement test scores, attendance records, sla IT personnel 
files): and asking people familiar with the ABE unit what aspects of the program mosL need improvement and 
at which points the evaluation effort might be most usefully focused. A summary based on this initial review 
would be helpful in orienting members of an evaluation committee. 

d. Estimate Resources - The Chairman has '.wo crucial resources. One is staff time to be released from other 
duties and assigned to ihej evaluation effort. "I'hc other is the budget aliucalion to be used for materials, 
outside consultation, data iproccssing, and the like. An early estimate of these resources can help deflne a 
realistic scope for the total evaluation effort. The estimate can also help determine the amount of these 
resources to devote to planning the effort, including the preliminary survey. 

c. Review this Guide -- At thiis stale ii would be helpful lor the Cliairman and perhaps some of the evaluation 
Commiltee iTiembers to roiid al least the early parts of this guide. A briefing session with an audio-visual 
presentation and discussioh could also be held. As a result of the initial review and the estimate of available 
resources, the chairman sliould be able to identify the parts of the guide that seem lo be most relevant and 
should better understand the preliminary survey within the context of the total evaluation effort. 

f. Adapt Survey Guide ~ The Preliminary Survey Guide is the basic instrument for collecting data for "the 
prel i mi nar.y ''survey. Its format allows easy selection and modification of items. The Chairman should discuss 
the Survey Guide\wiLh persons he wants to enlist in the total evaluation effort. This discussion will tend to 
clarify^hat is already known about the ABE program and will help lo identify those aspects that might be 
emphasi;^ed in the evaluation. If desired, questions can be added to the Survey Guide about other 
components that might be included in the main evaluation cTforl. Examples of these other components are 
counseling, materials development, finance, and program administration. The resulting data could then be 
used to specify the more; del^iiled items on each additional component that should be included in the main 
evaluation effort. This information could also be used to determine the relative emphasis lo place on those 
components. There are other ways that the Survey Guide can be adapted. For example, if a component 
already in the Survey Guide appears to warrant more in-depih initial evaluation, questions about it can be 
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added to the v^iiide Imm the lull set ol' evaluation instruments. Another way to adapt the Survey Guide 
would be to cut down the number ol" items lor components of lesser importance. Suggested items for such a 
shortened version of the Preliminary Survey Guide are listed below. 



Parts of Preliminary 

TSuTvcy" G u id e " 5e i ec fe cl 1 1 e rns' 

Recruitment 

Intended . , . , 2^ 3, 4 

Current 6, 7, 15 

General 14 

Staffing 

hUended ' \ 17, IS; 20 

Current .* 22, 23, 27 

General 28 

In-Service Education . . 

Intended 29, 31, 33 

Current. . . , 35, 36, 37 

General 38 

Instruction 

Intended 42. 43, 46 

Current ■ 50, 55 

General 58 

Collaboration 

Intended 59, 61, 62 

Current 63, 65, 67 

General 69 ""^^ 

Goal Selling 

Intended' 70, 71, 72 

Current 73, 74, 75 

General 77 

Other 81 



Typically this short form would be used for an interview with the local ABE director. Another version 
composed of the six general items (14, 28, 38, 58, 69, 77) could be used with a sample of students. These 
same six general items, along with items 37, 42, 50, and 81 , could be used with a sample of teachers. 

g. Perhaps Complete a Partial Evaluation - At the preliminary survey stage, the scope of the survey could be 
- restricted either to current practice or to intended practice. Though unusual, this might be desirable under 

some circumstances. For example, a director might decide to use only the current practice items from the 
Preliminary Survey Guide and to prepare from these findings a detailed description of the ABE unit. He 
would then submit the description to an outside evalualor, without aiiy accompanying information on the 
intentions of the ABE staff. The task of the outside cvaluator would be to identify the goals implicit in 
current practices. This might require additional investigation by the outside evalualor. He would then report 
on the importance and desirability of the implicit goals, and the feasibility of achieving them with the 
current program. The result would be a form of "goal-free" evaluation. Another example of partial 
evaluation would be for the ABE staff to complete only the intended practice items from the guide and then 
to discuss as a total staff the desirability and feasil^Iity of their aspirations. 

h. Agree on Plan Before collecting data^ the Chairman should review the preliminary survey plan with those 

people who will be most directly associated with it and whose understanding and support is most needed. 
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riicli agiOLMiiLMil on a plan can coniribuie lo both ihc errccitVLMicss ol" ihc survey and iheir commilnicni lo 
subsequeni evaluaiion aciiviiies. 

(2) Colleci Data - For many ABE programs, ihc pre!iminary survey will consist of inicrviewing the dirccior. I lis 
responses lo ihe Preliminary Survey Guide, along with the summary Irom ihe initial review, will provide the 
basis for planning ihe main evaluaiion eflori. As already meniioned, however, ii is somciimcs desirable lo adapl 
ihe guide. This ofien entails asl<ing some of ihe questions ol" at least a few other people, such as teachers and 
students, hi addition the suggested short form might be used with several members of the ABE administrative 
staff. Supplementary data might be collected about additional program components, such as facilities or 
program administration, both to make sure that they are included in the preliminary survey and to help specify 
the new items that should be written for additional program components. 

(3) Analyze Data - Once the data have been collec?ed for the preliminary survey, there are ihree basic steps in dala 
analysis. 

a. Identify Gaps - For most of the topics included in the Preliminary Survey Guide there are parallel items on 
. intended and current practice. Compare responses to intended-practice items with responses to 

current-practice items. Note substantial gaps between what is and what should be. These gaps suggest points • 
to emphasize in the main evaluation effort. 

b. Use Other Information - With the help of additional available information, from the initial review summary 
and from other sources, describe the program and interpret the findings from the preliminary survey. 

c. Apply External Standards - The final step in data analysis is to compare the descriptions that result from the ■ 
preliriiinary survey against external standards* such as the information in A\ppendix B. The comparison of the 
standards with the intents can help lo inlcrprel ihc' rlesirabiliiy and imporlance of program aspirations. ! he-- 
comparison of the standards with the results can help to, interpret program effectiveness. 

(4) Use the Results - The only reason to conduct a preliminary evaluation survey is to use the findings to help plan 
the main evaluation effort. The findings can contribute to the making of the following decisions: 

a. Fix the Focus - Identify ihe components and topics on which the main evaluation effort should focus. 
Generally, the greatest emphasis falls wherever the gaps between intended and current practice are largest, 
and wherever the commitment to close tliese gaps is greatest. 

b. Determine Scope and Extent — In general, the anticipated benefits from the evaluation sliould be greater 
than the investment in it. This rule of thumb will help define the scope and extent of the cflbrt. A favorable 
cost/benefit ratio typically occurs when the evaluation is focused on aspects for which improvement is most 
feasible. 

c. Select Participants — Intiudc both ABE staff members and outside evaluators in the main evaluation effort. 
Selecting major topics for the effort will suggest some people to be asked questions (because they know 
about the topic), some people to do interviewing (because they can do it well), and some people lo 
participate in the process (because they can help bring about the changes that are likely to be indicated by 
the findings). 

d. Set a Realistic Timetable - Experience with the preliminary survey will help the planners make realistic 
estimates of the tasks to be performed and the time needed to perform them. 

In these four ways, and in many minor ways, the experience and findings of the preliminary survey can 
contribute to a more efficient and effective evaluation effort. 
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Prepare a Detailed Plan 



With much of the inilial planning done, the time is now at. hand for working out the details of the main evakiaiion 
effort. This will involve decisions on the following. 

Narrowing ihc Focus. Very few ABE Linils conduct a comprehensive evaluation of liieir entire progran'i at one 
time, "i'hose that tlo rarely give equal attention to ail parts of the program. 

But being selective is dilTiculi. Because all components of the program arc connected, it is sometimes tricky to 
single oul one or several for evaluation. Moreover, few adult education units have generated the kind of program 
perspective necessiiry lo identify those program components on 'which evaluation could be most usefully focused. 
Also, evaluation procedures differ somewhat from one component to another, so that an administrator familiar with 
the analysis of financial data may be uncertain how to evaluate counseling services effectively, h'or the same reason, 
a tea.cher who routinely administers and inlerpreis achievement tests may be reluctant to conduct a statistical 
follow up of dropouts. 

This guide is desigtied to help ABE ^Jiaff members identify the program components on which they want to 
concentrate. If staff members already have a clear idea of what these components are, they can turn directly to the 
sections in the guide that deal with these components; If not, the staff members will fin-i it useful to map out the 
ABE unit's (unctions.. Some members who arc very familiar with the whole ABE unit can often quickly prepare 
an overview of the unit based on existing data, their own experience, and a modest survey. Such an overview should 
-report points at which especially useful ajid more detailed data are likely to be found, and rihould also help identify 
components of the tmit that need intensive evaluation. The preliminary survey, described on preceding pages, will be 
especially helpful in this respect. 

Once it has been decided which itrmis of what Components to include in the evaluation effort, the instruments 
can he modified so that they have the same items. Items in the components are cross-referenced lo make it easy to 
find the corresponding items in the instruments, and vice versa. 

Deciding on Detail and Precision. For almost any evaluation topic it is possible to ask one question, or five, or 
fifty. For almost any question, it is possible to obtain a rough estimate, a careful estimate, or a precise description. 
The extent of detail and precision that should be attempted depends on a mixture of what is desirable and what is 
feasible. 

When deciding how huich detail and precision is desirable, it is well to consider both importance and analysis. 
Data collected about more important topics should be more detailed and precise. Data to be used in more crucial 
parts of the analysis should be more accurate. 

The anx)unt of accuracy that is feasible depends on the availability of the data and the amount of effort that 
must be. expended to obtain it. Some data arc readily available in records or in the memory of respondents. But 
sometimes accurate data are not readily available. A record of trends in recruitment efforts or in job placement of 
participants may he scattered and buried in old files and may require substantial effort to locate. Recollections of 
participants about Mhe decision to enroll or drop oLit may be so faint and diffuse that the major influences on the 
decision can be reconstructed only with the greatest effort. In such instances it may be better to settle for a rough 
estimate that can be read il\' obtained, rather tiian lo expend great effort to get a more exact estimate. This procedure can 
be crucial when the respondent is the ABE director,, from wh6iiT~r~gix\aT^dear^^^ are to be obtained. '1 he 

burden of obtaining exceedingly detailed and precise data on all of the topics to which he should respond might 
become greater than he could justify." 

Adapting Instruments and Procedures. Although the instruments and procedures described in this guide have 
resulted from long and careful study of actual ABE programs, the variations from one program to another are so 
great that an instrument or procedure may not apply exactly in a specific instance. It will then be necessary to 
make some changes. The evaluation committee may wish to delete some evaluation items and add others. An 
instrument designed as a sell-administered quesjionnaire may need to be modified for use as an interview guide, or 
vice versa. The wording of individual items may need to be changed so that they better fit the local situation. 
Existing reports and data can be used lo supplement data from evaluation insirument.s. Such changes arc desirable, 
and the possibility of making them should be raised from time to time during the planning process. 

Sampling. Most evaluation activities do not require that date be collected from all persons or sources that arc 
involved. The standard procedure to handle this is sampling. When there are few people or sources from which data 
are to be obtained, it is most satisfactory to collect data from all of them. But as the amount of data to be 
collected from each person or source becomes greater or the number of persons or sources becomes greater, sampling 
shoLrld be considered. Although there are a variety of complex and specialized sampling procedures, the biisic and most 
useful procedure is random sampling. 
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Arranging Lxiernal llvjlu.iiion. Mosi cvakiaiiun clTuri^; arc subsianiially sircni"! honed if they include some cvaliia- 
liun by ouisiders Id increase the ohjeciiviiy of ihc results. In arranging for external evaluation, ihc following 
suggestions may be helpful: 

(1) Make the basic policy decisions about the evaluation effort internally. 

(2) Arrange lor the external evaluation early in liie planning stage so that the external evaluators can contribute 
lo the planning. 

^^) Concentrate the ellorts ot the externa! evaluators al those points at which objective and impartial evaluation 
is most Jilliculi 

In some instances, it may be desirable to assign must ot the responsibility for evaluation to externiil evaluators. 
I his cm be ilon*; in vaiious ways. One way is lo emphasize objectives. I^lrts of the intended-practice sections of this 
guide can be usctl lo prepare a tietailed statement of objectives. This can be given to an external evalualor to use as 
.1 basis lor conducting his own ev.ilujtion of the extent to which objectives are achieved. Another way is to go lo 
ihe other extreme and conduct a goal-iree evaluation in which the current-practice sections of the guide are used to 
{)rep.ire a del.iiled deseripiion of whai is being clone. 7'hc external cvaluator would use this description to identify 
I he gu^tls implicit in the program as it functions. A third way is lo arrange lot an external evaluation team to 
conduct ihe evahiation. using all or major pans of iliis guide, much as they might if ihey were conducting a 
research projeci. 

Q Collect the Data 

• With most of the general planning behind you, it is time lo get ready for the collection of data. 

Who Should Collect? Obvious candidates ior the job of colled ing d.ita are ihe .ABE director, a member of his 
staff, an ABL siaff committee on evaluation, an evaluation specialist in the school system, an outside evaluation 
consultant, or an outside evaluation team, liach has advantages and disadvantages, depending upon ihe siiuaiion. 
Those associated with the ABL unit have the advantages of fan^iliariiy with the program's past, a stake in the 
program's future, and easy access to much of the evaluation data. Outside evaluators have the advantages of greater 
objectivity, more evaluation experience, .md time specifically set aside for the evaluation effort. It is isually 
desirable lo include both insidets and outsiders in any evaluation effort. 

Mere are some of the. typical advantages and disadvantages of vaiious persons and groups as collectors of data: 

(1) ABE Director ' 

a. Advantages 

L Is familiar with total ABE unit 

2. Is responsible lor total unit- 

3. Can allocate resources for evaluation 

4. Mas some competencies related lo evaluation 

b. Disadvantages 

1. Is the source of much of the data 

2. hlas great 'ego-involvement in the program 

3. Mas heavy competing demands 

4. May cause some staff members not to be frank on certain topics 

• (2) A staff member 
a. Advaniages 

I. Released time may be easier to arrange than for the director 
• 2. Is familiar with parts of unit 

3. May be more interested or compelcnt in evaluation 

4. Involves a small commitment of staff time 



b. DisjclwirUagcs 

1. Miy Lick tamiljaiiiy wiih or comniiimcni it» some parts ul' unii 

2. May experience rivalry with other staff members 
.5..Ma> lack inilueiKe tieciieLi ine<»iulik"l p.nKol es.iluaiinn 

(3) Staff committee 

a. Advantages 

1. Can he representative of the whole unit 

2. Requires less time hy each person lor evaluation. 

3. Promotes greater likelihood of commitment lo inrplemcnt evaluation plans 
h. Disadvantages 

1. More total time spent on evaluation because ol committee activities 

2. Problems ol coordination between parts ol evaluation elTort handled by several people 

(4) Evaluation specialist from school 

a. Advantages 

1. Selected for competence in evaluation and institutional lesearch 

2. Can allocate lime for evaluation effort 

3. Mas access to resources related to evaluation 

4. I4as some familiarity with total system including ABE unit 

b. Disadvantages 

1. May not appreciate unique nature of ABE unit within sy^item 

2. May overemphasize testing students and underemphasi/e program evaluation 

3. May give too little attention to building commitment to use of evaluation results 

(5) Outside evaluation consLiltant 

a. Advantages 

1. Is selected for substantial evaluation competence 

2. Can allocate time for evaluation effort 

3. Has access to subslanlial Jesources rclaled lo evaluation 

4. Has greater experience with all aspects' of planning and conducting evaUiation 

5. Can provide objectivity for external eva lira t ion activities 

b. Disadvantages 

1. Requires separate budget allocation instead of U'-ing part of time of regular staff 

2. Has limited familiarity with local situation 

3: May entail some loss of control by ABE director over the evaluation effort 

(6) Outside eval'ution team 
a. Advantages 

1. Has greater competence on specialized aspects of evaluation effort 

2. Can allocal-e a greater amount of total time for effort 
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J. I las access to more i csdui ccs rdalcd lu evaluation 

A. Mas extensive evaluation experience 

5. IncluJes various viewpoints to minimize subjectivity and bias 

6. Includes enough manpower lo conduct intensive external evaluation in a minimum of time 

b. Disadvantages 

1. Requires separate budget and can be niore costly 

2. Has limited lamiliarity with. local situation 

3. Limits ABE director's control over evaluation effort 

4. Requires time, money and coordination to deal with interrelationships of team members 

In Weighing the foregoing advantages and disadvantages, consider the local circumstances and select the combina- 
tion of individuals and groups that seems most satisfactory. Where possible, avoid having people collect data from 
themselves. Although the use of self-administered tests and questionnaires can be efficient, for many evaluation 
purposes it is helpful for someone else to assist with the collection oi" data from any individual associated with the 
ABE program. 

How Should Data Be Recorded? The form in which data are recorded when collected can cither help or hinder 
data analysis. 1" he re fore, consider how the data are to be analyzed before deciding how to record them. 

The problem of recording data Is minimized if the data are to be analyzed by use of punch cards and a 
computer. Automated data processing is desirable when there is a large amount of data and there are many sources 
of data. Automated data processing is more feasible when the basic equipment and trained personnel are available, 
because someone who is familiar with automated data processing and computer utilization can work with the 
persons who arc planning the evaluaTion effort. One contribution that data processing personnel can make is to help 
plan the forms that will be used lo collect and record data, such as questionnaires, interview guides, and observation 
checklists, so that punch cards can be prepared directly from them. 

In many instances, however, the use of punch cards and a computer is not warranted. This guide's approach lo 
evaluation emphasizes the analysis of basic data within fairly small categories. Thus the data on intended practice 
for recruitment of participants is analyzed separately from the data on current practice for recruitment. In most 
ABE units, the number of persons and sources from which evaluation data are collected is small, with the possible 
exception of students and teachers, where sampling procedures can be used. 

When the data are to be analyzed by hand, a form can be set up so that the data are recorded in a way that 
facilitates analysis. This is illustrated by the Teacher Rating Form. When the number of variables to be analyzed is 
relatively small (less than 20 variables), the same i'om can be used to record and to analyze the data. When there 
arc more variables (20 -60), the data can be transferred to a single summary form. 

When the form is completed, usually by entering the code numbers for each variable along the right margin, the 
set of forms is sorted into piles based on the code numbers for important variables. For example, if the data deal 
with factors associated with student persistence and withdrawal, the criterion variables might be the number of 
weeks that the participant persisted in the program before withdrawing. Those who persisted two weeks or less 
might be coded a 1, three or four weeks a 2, and five or more weeks a 3. The forms would then be sorted into 
three piles according to their number. Each pile would then be sorted according to other variables thar might be 
associated with extent of persistence. The frequency distributions for each of these predictor variables, such as age, 
reading level, and the distance between the participant's home and the ABE class location, could then be obtained 
by simply counting the number of forms in each pile. Comparing frequency distributions could indicate that 
participants with some characteristics typically persist longer than others. If neither age nor reading ability were 
associated with persistence, but traveling distance was, the evalualors could pursue this further' in relation to 
available travel facilities and policy on satellite locations. 

Reporting Distributions. Many items call for respondents to circle a number from 1 to 7 to indicate where their 
answer falls within «i range of possible responses. In summarizing or reporting such responses, the analyst can report the 
distribution in the following way: . 

Concentration of responses Reporting Oescription 

low 

moderdlcly low 

modcraie 
moderately hiyih 
high 



1 J 

2 • >} 

3- 5 

4- 6 
■ 5-7 
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In more clci.iilcii icchnic.i! lopoils t)i dila Irum mullipk' rcspondonis (e.g., io;ichors), Iho jn.ilysl .should k'jsi 
rcpori the moan and ianj;o ol scale scores for each calcgory of respondents on each scale. A Iretiuency disirihiilion 
should be prepared so ihai oihci descriptive siaiisiics can be computed, such as the median and mode. 

Intended and Current Practice. In the collection ot dM from a respondent, it is tmporiant that questions about 
intended practice be asked lirst ar.d questions about ciiirent practice second. This sequence results in less disiortit)n. 
When a person is asked about his intention, he usually describes It as lie sees it. Then, when he is asked aboiu what 
actually occurred, his response is dictated by lacts that m.iy or may not correspond to the intention. But il' he describes 
intended practice c/Z/t^r current practice, there is a tendency to reflect greater cotisistency than actually occurred. 

Reliability of Data. If the evaluation da:.* that are collected arc unreliable, the conclusions based on the data will be 
•unsound. Reliability is ihe extent to which several compar<ible efforts to describe something will produce the s<inie 
description. When the description Is quantitative, sLtch as the number o( dollars spent or the number of students in 
class, a spot check. Is usually sullicieni (o reasstire the evalualor that the date are reliable. But qujiiiative descriptions, 
such as a list of goals implicit in an Alill statement of purpose or a list of the contents emphasized by a teacher during a 
class. session, are another mailer. In such instances, il i.^ desirable lo have iwo or more persons rate the goals sialemeni 
or the class ses.sion, using the s.ime rating procedt»res, lOid to compare the resulting ratings. The extent ol similarity o( 
these Independent but comparable ratings is a measure of the reliability of the rMcr^. The higher the reliability, the 
more confident everyone can be that the judgments or conclusions of the evaluation report <irc based on valid 
descriptions not greatly distorted by subjective bias. 

Discrepancies revealed by these initial ratings should be discussed so that the raters will approach the future rating 
process as unilormly as pi."»ssible. 

Analyze and Interpret the Data 

The re<tson for analyzing and interpreting evaluation data is to prepare a report that will give persons associated with 
the ABE unit a better understanding of ihc way it fimctions. The process of data analysisand interpretation typically 
entails four steps for each of the program components: (1) description of intended practice, (2) description of current 
practice, (3) comparison of intended and current practice, and (4) comparison of the information gathered with 
information about external standards. In the process of analysis, data are included from the instruments on the 
appropriate component, from relevant items in other components, and from sources not included in this guide. 

Tor analysis, the data recorded in ihc. in'strumenls need to be rearranged according to the major program 
components- recruitment, staffing, and so forth'. This can be done simply hy transferring inlbrmation from the items in 
the instruments to the corresponding items in the appropriate components. I'or example, the Administrative Stalf 
Interview Guide, The Director Questionnaire the Program Statistics Form, and the Student Data Form all will contain 
data on recruitment. This data can be entered tinder the appropriate items in the Recruitment section of Pan 111, "What 
to Evaluate." Each item is cross-referenced to the component and lo the nimiber of the corresponding items in that 
compbnem^- Thus, the first item in the Administrative Staff I nterview Guide is identified a.s "I. (Reel)," meaning that 
it corresponds to Recruitment item #1. Items in some of the forms arc not cross-rcfereiiced in this manner because all 
of the items in the form are duplicated in the components section noted in the upper-right corner of the form. Another 
way to organize data for analysis is to niiike a photocopy of the set of instruments, and then to cut apart the copies of 
responses related to each component so they can be grouped together, read, and a stimmary prepared. 

Analyzing Intended Practice. The data on intended pr<ictice reflect intents, expectations, and serious aspirations. The 
data, describe what various respondents see as both'desirable and feasible. For example, students, teachers; and 
administrators each have expectations about the instructional process, although these expectations are likely to vary 
not only from one group lo another, but also among people within a groLip. One way in which; the data on intended 
practice can he analyi'.ed is to find out how much consensus there is for respondents within each*' category. Do various 
representatives of collaborative groups view co-sponsorship with the ABE unit in similar ways? ■ ' 

Another way to analyze the data is to compare the expectations of respondents who have different roles, (low 
similar are the expectations of the ABE teachers regarding the goal-setting process to the expectations of the 
administrative staff? Brief summaries of the expectations of two or more categories ol respondents can be prepared. 
The summaries can contain both statistical data and qtialilative descriptions. These summaries can then be compared. 




I he \o^\i: ut I he i clalionships heiwccn items can also he analy/ed. This analysis can be conducted \'oi the data from a 
single respondent, trom a caiegoiy ot respondents, and from all respondents. ■ for example, questions such as the 
following can be answered. Is it reasonable to expect that if the intended resources arc provided, the intended people 
will be able to perform the intended roles? Is it likely that the intended people performing the intended roles will be 
able lo «ichieve the intended outcomesi^ 

Analyzing Current Practice. The data on current pr.LCtjce provide a description of ihe. ABE program as reported by 
various respondenis. ["his descripiion Incli/des ihe people and resources lhai are actually available as well as the actual 
results. An early stage of the data-analysis process. consists of comparing and combining ihc data on each variable IVom 
various people and sources to produce the most accurate descriptii>n of the variable. For example, if the variable is the 
proportion of stoilefiis who remain In the ABI: program lor a certain length ol .time, then the aim is to come up with 
the most accurate percentage feasible. 

The main analysis of the data on current practice consists of an examination ol the empirical connections between 
resources, procedures, and results. This analysis can be used to answer the I'ollowing queMions: 

(1) To what extent and in what ways do resources influence procedures?- Hor example, what is the impact of 
programmed materialson the instructional process? What is the impact of outreach classes on recruitment of the less ■ 
educated? 

(2) . To what extent and in what ways do procedures achieve various outcomes? For example, docs the recruitment 
strategy attract many new enrollees, but retain lew beyond several weeks? Do tiie goal-setting procedures result in 
attractive statements of goals but little staff commitment to achieving them? 

(3) Which procedures are most effective in the achievement of the major outcomes? For example, do people in 
complementary occupations who work part-time doing ABE liaison work produce better results than people from 
target neighborhoods who work lull-time lor the ABE unil? Does the learning lab produce higher achievement than 
the standard classroom? 

The conclusions should suggest ways of improving the ABE unit. Two examples of such conclusions follow: (I) 
inviting outstanding teachers from nearby ABE programs to participate in staff development activities produces more 
lively and interesting sessions. (2) Role-playing is more effective than group discussion in increasing the ability of 
participants to cope effectively with job interviews. ' 

Comparing Intended and Current Practice. The parallel sets of items on intended and current practice can be 
compared to find out if the intended people and resources arc being acquired, if people. are doing what they say they 
are trying to do, and if the expected results are being achieved. The purpose ol these comparisons is to find out if there 
are discrepancies between intended and current practice, and if there are, to help decide whether to change 
expectations or activities or both. 

Checking External Standards. A major task in any evaluation effort is to interpret the results of the data analysis. 
Part of this interpretation is internal, based on the history, character, and rationale of the ABE program. Part is 
external, measured against experience elsewhere. "I hc highlights of outside experience can" be thought of as standards 
for comparing and interpreting the results of the evaluation effort. If a dropout rate of 30 percent is discovered, is this 
good, bad, or indifferent? Much depends on the experience of similar ABE programs. For example, it would be 
en'.ighicning to know that 9U percent of similar programs have higher dropout rates. Not that this would justify the 30 
percent dropout rate, but it would help to interpret it. A relative standard provides a basis for comparing one program 
with others. The purpose of comparing the results of evaluation with an external standard is to interpret the results as a 
basis for action. Data on external stadards arc found in Appendix B. 

The foirowing questions can giijdc the comparisons. Do the per.sons associated with the ABE unit aspire to what 
others consider the mbsl important goals? Have the local expectations ever been achieved elsewhere? Do they seem to 
be feasible? The answers can be of value in assessing the importance of the goals and the effectiveness of the procedures 
used to reach the goals. 
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Part III 



WHAT TO EVALUATE 

Lxicnsivc icsciich has ick'niilicJ six components iisccnirjlly important to most ABI: progiam!>. Those. components arc 
recruitment of students, slalfing, in-service eclucatii)n of teachers, instruction, collaboration, and goal setting. Each 
functions through the interaction of various persons associated with the ABli unit. For example, the director works 
with recruitment aides, teachers, and representatives of community groups to recruit students. Knowledge of how these 
six components function provides a relatively comprehensive overview of the entire ABt unit. Those who plan and 
conduct an evaluation effort can include any or all of these program components as well as any additional components. 

The components are closely interrelated. Recruitment of students and staffing, for example, are bound to affect 
instruction. And goal-selling certainly influences all oi ihe other components. Since one component affects another, 
there is overlapping. The number and characteristics of students, for instance, Is an outcome of recruitment and is an 
influence on instruction. 

The sections lh.it follow contain evaluation iten^s for each program component. Arranging the Items by components 
facilitates the in-depth appraisal of any component of the ABE unit. Bui the process of collecting data needs to be 
organized around the sources of data. Thus all questions to be asked of teachers should he assembled in one instrument. 
This has been done in Part IV, fi valuation Instiiiments. InParflV, ihv^ evaluation iteii1^"';for Ctich program component 
have been rearranged acc<Trding to source (and usually rephrased in question form). There arc instruments to secure 
information from program administrators, lab supervisors, the director, teachers, students, atul program co-sponr.ors. 

The accompanying table shows which program components arc included in which instruments. This table is useful 
when an evaluation effort is concentrated only on some of the components. If those components, for example, are 
recruitment and in-service education, only the recruitment and in-service sections of the instruments checked needTcT 
be used. These would include the recruitment sections of the Preliminary Survey Guide, the Admintstrative Staff 
Interview Guide, the Director Questionnaire, the Program Statistics Form, and the Student Data Form; .ind the 
in-service education sections of the Preliminary Survey Guide, the Administrative Staff Interview Guide, the Director 
Questionnaire, the Teacher Questionnaire, and the In-Service Education Content Form. 

If only certain items in the 'sections on components are to. be evaluated, the corresponding items in the instruments 
are easily located by means of the crossrreferencc immediately following the nimiber of each item. 



INSTRUMENTS 

Administrative 

Prclimitiary Staff ^ Program 

Survey Interview Director Teacher Statistics 

Components ^ Guide Guide Questionnaire Oucstlonnalrc Form Others 

Rccruiumnt \ \ \ \ x Student Data Torm 

St.iiting X X \ X \ X Teactier Rating f'orni 

X Teactier Data Form 

In-Service lidutation .. \ \ x . x x ttbServico Education Content I'orm 

Instruction x x x x \ x Lab Supervisor Interview Guide 

X jiiiucnt Questionnaire 

x Classroom Interaction Rating Form 

Collaboration ........ \ \ \ x Co-Sponsor Questionnaire 

X Co-Sponsor Data Form 

Goal Setting x x x x Goal Setting Process Form 



Recruitment 

v^. ■ -. 

Recruiting new students is as vita! to an ABE program as food is to the human body. Some new students arc recruited 
through no effort on ihe pari of the program. These students decide to enroll generally because they have heard about 
the program from others. Most ABE programs, however, cannot rely on this "passive recruitment" alone. They must 
use active meaiib to keep their student enrollment at desired levels. 

"The nature and extent of ah active recruitment effort depend on such factors as currcrit ei^ oilmen t in relation to 
anticipated growth, characteristics of the target population, linkages with co-sponsoring organizations and referral 



1 



14 



agencies, visihiliiy .iiul refuiijiion of the pioi»ram in the comnuinity, compeiilion IVom olher ABli-iype programs, 
and availability of sialf time and money. 

The recruitnient process consists of transmitting; messages about the program through channels to a target 
audience of potential students. In an active recruitment elTort, the ABE program decides on the^ type- ot" .message 
sent, the" channels to lie useti, and the n.iture ol the target audience. The way the target audience is del'ined greatly • 
alTecis both the content of the message and the channels used to transmit it. 

"Fhe success ol' recruitnuMit activ'ities can -be measLired in several ways. One way is to compare the nun'iber ul" 
persons who enroll wilh past enrollment .figures or proiected enrollment. Another Is to compare the actual charac- 
teristics of those who enroll with the intended charact Mistics. A tliird measure of success is the percentage of 
recruited students who remain in the program. 

Recruitment affects and is affected by oiher major program activities. Goal setting, which includes defining the 
target popolan'on. directly affects not only the target audience for recruitment activity, but also the type of message 
sent and the channels used. The characteristics of the recruited students, in turn, affect the nature of instruction 
and the competencies required of the professional staff. 

Data for Evaluating the Recruitment Process 

l:ach ol lhe loll(iwin:< iiefiis seek inlormatiofi .ihai accucatelv tlescf ihes (he par t (jI your prograrn related l(j recrinimeni. 
The letters in the left .margin indicate whether an item is seeking inlormation on (I) intended practice, (C) current 
practice, or (IC) both. If there is no letter, the item is general. Parallel items of intended and CLirrent practice are listed 
as A and B of the Stime number lor easy comparison. 

All items are cross-referenced to corresponding items in the evakiation instruments. The cross-reference is in 
parentheses followifig the item number. It gives the name of the instrument (abbreviated) and the number ol the 
corresponding item in that instrument. The page numbers of the instruments are listed on the Contents page. 

1 1. (Adm. Gd., I) Kinds of staff (e.g., teachers, aides, counselors) that should be involved in recruiting 
activities: 

2A. (Adiii. Gd., 2) Hours per week that typical staff members 5/?o^//6/ speMul on recruitment: 

2B. (Dir. Oues.,S^ Hours per week thai the average staff member docs spend on recruitment: 

Siaff Caicgory Hours per Week 

Tc.ichcr 

Aide (pjr.ipiotcssiun.tl). 

Counselor . 

Supervisor , 

Alii: Direelor 

Oilier (speeily: — ) ' 

3. (Adm. Gd., 3; Dir. Ques., 2) Percentage of ABE budget and administrative tfrne that should be and /5 
ailocalod for recruiting students: 

A. Should Be B. Is ■ 

I3udgel % % 

Adminisiraiivc lime % % 

4. (Adm. Gd., 4) Methods that should be emphasized in the recruitment of students for your program: 

5A. (Adm. Gd., 5) Recruitment methods mentioned above that should be used to reach particular target 
groups (c.g, young males, non-l£nglish speaking, least literate. Blacks): 
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C 513. (Dir. Quci., 3) I he one or two methods you currcnily rely on most (or recruiting persons in various 
groups (use checkmarks): 



Groups 

Young adulls 

Non-tniilish speaking . 

Blacks 

Mates 

Unemployed 

Leasl lileraie 

Oiher 

Oilier 

Other 



Uoor 
•lo- 



Mass 
Media 



Kccruiiment Mettiods 



Agency 
ReCerraf 



Co-sponsored 
Classes 



Word of 
Mouth 



Other: 



IC 6. (Adin. Gd„ 6; Dir, .Ques,, 4) The main recruiting messages that you intend to convey and actually get 
through: 



A. Intended 



B. Actual 



! 7, (Adm. Gd., 7) Characteristics of the target population you are trying to reach (age, sex, ethnic back- 
ground, place of residence): 

I , 8 A. (Adm. Gd., 8) Particular groups you especially try to reach (e.g., young males, older adulls. Blacks, 
non-English speaking, least literate), and which ones are high priority: 

C 8B. (Dir. Ques., 5) Actual success in reaching various groups, compared with expectations (include any 
additional groups you attempted to recruit): 

Recruitment Success 



Group 

Young adulls 

Non«l£f)glish speaking . . . . 

lil.icks 

Unemployed 

Males 

Least Literate 

Other 

Other 

Other 

General Target Population 



Little or 
No Success 



Gre.it 
Success 



- 2 
2 
2 
2 
2 
2 
2 
2 
2 
2 
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9. (Adm. Gd., 9) Dci>irvcl enrollment, given present resources: students 

10. (Dir. Ques., 6a) Is your current enrollmeni as high as budgetary resources will permit? Yes 

No 

I i. (Dir. Ques., 6b) Diliiculty in recruiting ihe kinds of students desired during the pjst year: 

Little or Great 
No Difficulty Difficultv 



I '.3 3 .1 5 6 7 

12. (Prog. Stat. Form I) Besi estimate of the maximum number potential ABE students in your city or 
service area: 



!3. (Prog. Stat. Form 2) Approximate total number of students who currently participate in your ABE 
program in a typical week: 

14. (Prog. Stat. Form 3) Total annual enrollmcnt for each of the past four years: 

Total Annual 
Year Enrollment 



Lust 

19 

19 

19 



15. (Adm. Gd., 10; Prog. Stat. Form 4) Percentage of students enrolled at the first week in the fall who arc 

still active as of the sixth week of class: 

A. Your goal % B. Experience last fall % 

16. (Adm. Gd., 11) Suggestions for improving recruitment: 
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Summary of Student Data from the Student Data Form 

Total number of students or total In sample 

1. IJy approximate j^ratle level: 

a. l^eginning ( I --3) • 

h. Iniermediate (4 ■ 6) 

c. Advanced ','7-8) 

d. GKD (H.S., c^uiv.) 

'i. By sex: 

a. Male 

b. Female 

3. By age range: 

n. 1 7 or less _ 

b. lS-24 . J 

c. 25-3^1 

d. 35-44 

e. 4S~S4 . 

r. 55-64 

g, 65 and over . 

4. By race: 

a. White " 

b. Black 

c. American Indian . 

d. Oriental 

e. Other non-White , 

5. By ethnic Group: 

a. Cubans . 

b. Mexican-American 

c. Puerto Ricans 

d. Other 

6. Migrant • 

7. Welfare recipients (estimate) , ^ 
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Staffing 



Staffing includes recruiting and hiring teachers and other personnel and assigning them in the ABE program. Staffing is 
obviously important because the competencies of teachers and other personnel bear directly on the effectiveness of the 
program. 

A first step in the staffing process is to determine the criteria to be used in selecting teachers and other 
personnel. Certain criteria arc determined by the ABE program, but others may be mandated by the state law, local 
school system policy, or union contracts. These criteria may be related to certification, training, professional 
experience, race or national origin, personality, or other factors. 

Onco seleciiun criteria have been ascertained, the next step in the staffing process is recruitment. Major sources 
of ABE teachers include elementary and secondary school teachers, other professional school syslem employees, and 
persons outside the school system who may or may not have had training and experience in teaching. Counselors, 
supervisors, and olher professional personnel lend to be recruited from similar pools. Paraprofessionals, both paid and 
volunteer, are recruited from a variety of sources, including collaborating organizations. 

The process by which teachers and other personnel are recruited and selected varies in complexity and 
formality. In some cases, the director or u staff member encourages promising teachers of adults to apply for an 
opening. In other cases, openings arc posted, formal application through the school system is required, and the selection 
process is more impersonal and mechanical. 

After a teacher or other staff member has been hired, the final step in the staffing process occurs— the assignment of • 
the new slaff member to a particular position or to specific duties. In the case of teachers, personal characteristics such 
as age, ethnicity, and professional experience may be taken into account in making teaching assignments. 

One measure of the success of staffing efforts is the degree of correspondence between intended and actual staff 
characteristics. More enduring measures include staff statisfaction and morale, turnover, teaching effectiveness, and, 
ultimately, student achievement and persistence. 

The staffing process, of course, is closely tied to other major program activities. The goals that are set for the 
program, for example, are often major determinants of the selection criteria used in hiring staff. Co-sponsorship 
arrangements may also affect staff recruitment and selection. In-service education is influenced greatly by who is hired. 
Perhaps most important, the teachers who are hired have a major, if not decisive, influence on the nature and 
effectiveness of the instructional program. 

Data for Evaluating the Staffing Process 

Each of the following items seeks information that accurately describes the part of your program related to staffing. 
The letters in the left margin indicate whether an item is seeking information on (I) intended practice, (C) current 
practice, or (IC) both. If there is no letter, the item is general. Parallel items of intended and current practice are listed 
as A and B of the same number for easy comparison. 

All items are cross-referenced to corresponding items in the evaluation instruments. The crossreference is in 
parentheses following the item number. It gives the name of the instrument (abbreviated) and the number of the 
corresponding item in thai instrument. The page numbers of the instruments are listed on the Contents page. 

IC 1. (Adm. Gd., 14; Dir. Ques., 13) Percentage of ABE budget and administrative time ihdii should be and fs 
allocated for staffing: 

A. Should Be B. Is 

Budget % % 

Administrative time % ^'•*% 

IC 2. (Adm. Gd. 15; Dir. Ques., 12) Person or persons y^ho should have and do have the most to say in determining 
. the criteria used in hiring teachers: 

A. Should Have B. Do Have 

1 3. (Adm. Gd., 12) Criteria that should govern the selection of ABE teachers, aside from personality and criteria 
mandated by stale or local regulations: 
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I 4. (Adm. Gd., \3) Crlicrid ihia shoi//d gowcrn the sclcciion of insuucii'oivW aides; 

C 5. (Dir. Quos., 14) Importance of various criteria in tlie actual recriiltmcfU and seleciiun of staff: 



Utile or No Great 
^'^^Tia Importance Importance 

a. Rucjular school stjiff , 12 3 4 5 6 7 

b. Experience leaching adults I 2 3 4 5 6 7 

c. Age I 2 3 4 5 6 7 

d. Elementary education experience .... I 2 3 4 5 6 7 

e. Ethnicily I 2 3 4 5 6 7 

f. Place of residence .- I 2 3 4 S 6 7 

C 6. (Dir. Qucj., 15) Difficulty ol competing with other employers in recruiting staff. 

Very Difficult, Poor Easy, We Have a 

Competitive Position Great Advantage 

12 3 4 5 6 7 
I 7. (Adm. Gd., 16) Should any effort be made to recruit ABE teachers from outside the public school system? 

Y es No 

! 8. (Adm. Gd., 17) If yes, from what sources? 

C 9. (Teach. Ques.,1) Occupation of teachers when first hired: 

a. Employed by a public school system 

b. Employed in business or industry 

c. Employed as a housewife 

d. Employed in some other capacity (specilV:_ - ) 

c. Unemployed 

! 10A. (Adm. Gd., 18) Persons who should be actively involved in selecting and hiring teachers, and what their 
roles s/70i^/^/ be: 

C lOB. (Dir. Ques., 16, 17) Persons who are actively involved in sc^lecting and hiring teachers, and what their roles 
are: 

Persons Roles 

a* ABE Director 

b. ABE Teachers 

c. ^ School Personnel 

Office 

d. ABE Supervisors 

c. Olhcr (specify: 
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1 1 A. ( Adm. Gd., 19) Factors that should be taken into account in assigning teachers to a particular class: 



1 1 B. (Dir. Ques., 18) Factors that are generally taken into account in assigning teachers to a particuL. class: 



a. Icachcr's prior experience and/or training 

b. Eihnicity of teacher 

c. Sex ot teacher 

Aijc of teacher 

e. None of tl)c 'h^x^o 

f. Other (specify: ) 



12. (Adm, Gd., 20) Desired composition of instructional staff: 











Aides 




Minimum 
Percent 


Maximum 
Percent 


No. 
Pref. 


Minimum . 
Percent 


Maximum 
Percent 


No. 
Pref. 


Age 
















Under 35 


% 


% 




% 




% 






% 


% 




% 




% 




SO iw i\\ nil* 




0/ 
/£? 




% 




% 




Sex 
















• 

Male 


% 


% 




% 




% 




Female 


% 


% 




% 





% 




Ethnicity 
















Black 


% 


% 




,0 




% 




Wh? to 
W ill IC 


.0 


<(> 




% 




% 




Hispano- American 


% 


% 




% 




0/, 




Other (specify: 


^0 


% 




% 




% 




- ■ 1 

Training 
















Elementary 
Education (K-6) 


% 


% 




% 




% 




Secondary 
Education (7-12) 


% 


% 








% 




Other Education 
!* ra I n r n s pec i f y : 

a: 




% 




% 




% 




b: 


% 


% 




% 




% 




. No prior preparation 
In education 


% 


% 




% 




% 





















13. (Dir. Ques., 7) Expected overall performance of instructional staff: 

Percentage u 
Teachers Aides 

— . ■ 

a. Excellent % % 



b Very Good % % 

c. Good . % % 

d. Fair % % 

e. Poor % ' % 

Total = 100% 100% 
21 



14. (Dir. Qiics,, 8) linpoii.inco of icachcrs getting along well with other staff members: 



.1. Other TiMchers . 

Aitfcs 

c. Counselors . . . . 
tl. Supervisors . . . 
e. AHli Director . . 



Not 
Important 



3 



A 

3 4 
3 4 
3 ■ 4 
3 4 



Very 
Important 



6 7 

6 7 

6 7 

6 7 



Not 
Applicable 

0 
0 
0 
0 
0 



1 5. (Teach. Qucs., 2) General rei<iiit)nship currently existing between teachers and other staff members: 



Staff Category 

a. Oth<»r TeachorS 

b. Aides 

c. Counselors . . . 
(J, Supervisors . . . . 
e. ABE Director . . 



Unsatis- 
factory 



Moderately 
Satisfactory 

2 
2 
2 
2 

9 



Very 
Satisfactory 

3 
3 

3 
3 
3 



Not 
Applicable 

0 
0 
0 
0 
0 
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1 6. (Dir. Qucs., 9; Teach. Ques., 3) How satisfied your teachers are expected to /;e and are: 



a. Very satisfied 

b. Moderately satisfied. . . . 

c. Dissatisfied 

Total 



A. Percentage 
expected to he 



% 
% 



B. Percentage 
that are 



% 
% 
% 



1 00% 



1 00% 



IC 1 7. (Dir. Qucs., 1 0; Teach. Quel., 4) How committed your teachers arc expected to be and actually are to the goals 
of ABE: 



a. Highly committed ... 

b. Moderately committed . 

c. Uncommitted . 



A. Percentage 
expected to be 



% 
% 
% 



B. Percentage 
that say they are 



% 
% 



100% 



Total = 100% 

IC 18. (Dir. Ques., 1 1 ; Prog. Stat. Form, 7) Expected 2iV\di actual iurno^Qr o\ teachers annually: 

A. Expected B. Actual 

Heavy (25% or more) 

Moderate (10-24%) 

Light (less than 1 0%) 
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19. (Adm. Gd., 21) Suggestions for improving the staffing process: 



Summary of Teacher Data from the Teacher Data Form 

A. Total number of teachers surveyed 

B. Type of class taught: 



1. ESL (English 

as second language) 

2. Basic Education 
for Native Born 



Professional background: 

(. Elementary Education (K-6)_ 

2. Secondary Education (7-12)_ 



3. Both d 
Basic Eci. .ation 



5. Other 



4. Learning Lab Only 



3. Other Education Specialty 
(specify: 



4. Other 



D. Ethnic background: 
I. White 



2. Black. 
4. Other. 



3. Hispano-American 



Sex: 



F. Age: 



I. Male 



1. Under 35 



2. Female 



2. 35-49 



G. Employment status in the ABE program: 

1. Part time (less than 20 hours per week) 

2. Full-time (20 hours or more) 

H. Years of ABE leaching experience: 



1 . 1 year or less 

2. 2 years 

3. 3 years 



3. 50 or older 



4. 4 years 

5. 5 years 

6. 6 or more years 



Summary of Teacher Rating Data from the Teacher Rating Form 



1. Poor. 



2. Fair 



Overall Performance 
3. Good ' 4. Very Good . 



5. Excellent 
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In-Service Education 



Adult basic educatiojp is a borrower. It borrows many of its teachers, curricula^ teaching methods, and instructional 
materials from preparatory programs designed for quite different people. Thai is why it is important that teachers and 
staff members receive special instruction while serving in an ABE program. Most programs do offer some son of 
in-service education, whether it be n local workshop, a regional staff training program .sponsored by the U.S. Office of 
Education, or a university course in adult education. 

As used here, thejterm in-service education refers to organized efforts to help ABE staff members acquire, enhance, 
and update the professiona! skills, attitudes, and understandings needed to improve their performance. As conducted by 
local ABE units, in-service education ranges from meetings devoted largely to administrative and procedural matters to 
sessions on the analysis and improvement of instructional practice. Often local workshops are staffed by supervisors or 
experienced teachers^ and by visiting resource persons from a university or state education department. 

Many variables affect the extent and type of in-service education. Money and staff time arc certainly important. So 
are the fine print in the union, contract, the previous training of teachers and staff, and the provision, if any, of extra 
pay for taking part in the in-service education program. Also important are the planners' perception of staff training 
needs, the receptivity of the ABE staff to in-service education, and the ways in which the planners use local and outside 
resource people. j . " 

Central processes involved In in-service education include selecting trainees and trainers; deciding on site and 
facilities needed; and choosing the' form of training, such as conference, workshop, classroom observation, coaching, 
individual study, orjuniversity course. Program development— setting objectives, selecting and organizing subject matter, 
choosing methods and techniques, carryinu out evaluation and follow-up, deciding who does what to whorn-isat the 
heart of things. Planning, scheduling, and budgeting are important collateral processes. 

Many possible bjenefits can spring from in-service education. Improved attitudes, concepts, and skills are frequent 
results. Teachers completing the training are often better able to organize instruction, respond to student needs, and 
.select and adapt instructional methods and materials. They tend to acquire increased insight and more positive feelings 
toward students, jcolleagues, the ABE program, and themselves. Higher morale, greater receptivity to future 
staff-training programs, and increased ability to train others are also potential outcomes. 

In-service education is intimately related to other ABE program activities. Clearly, the staffing process itself largely 
determines the types of competencies that need to be developed. To some degree, the objectives of in-service education 
programs are influenced by the general goals of the ABE program. The kinds of students recruited into the program also 
affect the types ofj skills that staff members need to develop. The nature of co-sponsorship links with other community 
organizations can affect stafi-cducaiion priorities, too. 

In-scrvice education applies to all staff members of the ABE unit. Where not otherwise designated, the items that 
follow refer to a1l| ABE staff members. Some items apply especially to, teachers, to counselors, to aides who work 
directly with the instructional program, to administrators and supervisors,' or to others. The major emphasis, however, is 
on in-service education of teachers. 

Data for Evaluating the In-Service Education Process 

Each of the following items seeks information that accurately describes the part of your program related to 
in-service education. The letters in the left margin indicate whether an item is seeking information on (I) intended 
practice, (C) current practice, or (IC) both. If there is no letter, the item is general. Parallel items of Intended and 
current practice arje listed as A and B of the same number for easy comparison. 

All items are cross-referenced to corresponding items in the evaluation instruments. The cross-reference is in 
parentheses following the item number, h gives the naijie of the instrument (abbreviated) and the number of the 
corresponding item in that instrument. The page numbers of the instruments are listed on the Contents page. 

IC 1. (Dir. Ques., 21, 24) Annual fluids for in-scrvice education: 

A. Needed $ I B. Spent last year $ '. 
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IC 2. (Adm. Gd., 22; Dir. Ques., 22, 23) Pcrccnlagc of operating budget and of administrative time ih^i shou/d 
be used and was used last school year for in-service education (e.g., v^orkshops, conferences, courses) for 
all categories of staff (e.g., teachers, aides, administrators): 



A. Should Be Used 



B. Used Last Year. 



Budget 

Administrative time 



3A. (Adm. Gd., 23) Percentage of staff that should attend an in-service workshop, university course, or 
regional conference during a year: 



Staff Category 

a. Teachers and counselors 

b. Aides 

c. Supervisors and adm/nisirators . 

d. Others (specify: 



) 



Percentage That 
Should Attend 



J/o 



3B. (Dir. Ques., 19) Percentage of staff that participated in in-service education within the pabl year or 
within the past three years (if none, so indicate): 



Conducted by 
Your ABE Program 



Conducted by Others 



Staff Category 

a. Teachers and c<^unselors 

b. Aides 

c. Supervisors antl administrators . 

d. Others (specify: 



Past 
Year 



Past 
Three Years 



Past 
Year 



) 



So 
J/o 



J/c 
J/o 



Past 
Three Years 



IC 4. (Adm. Gd., 24; Dir. Ques., 20) Criteria for selecting participants in an in-service education program (e.g., 
prior training, supervisor selection, duration of employment, self-selection, category of position): 



A. Criteria That Should Be used 



B. Criteria Used in Past Year 



I 5A. (Adm. Gd., 25) Emphasis should be given to various forms of in-service education: 



No 
Emphasis 



Great 
Emphasis 



a. Novice-master assignments 

b. Participation in curriculum development . 

c. Coaching by supervisors or others • • • •. 

d. Workshops and conferences conducted by 
your ABE program 

e. Workshops and conferences conducted by 
others (state or regional agencies or 
institutions) 

f. Participation in university courses 

g. Other (specify '. 
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C 5B. (Teach. Ques., 30) Umphasis that has been given to various forms ol* in-service education in your own 
program, and the value of this experience to teachers: 



a. Assignment to work in the classroom of a 

more experienced teacher or staff member 

b. Participation in curriculum development . . . 

c. Coaching by supervisors or others 

d. Workshops and conferences conducted by • 

local ABE program 

e. Workshops and conferences conducted by 

others outside your local ABE program . . 

f. Participation in university courses related to 

your work in ABE 

g. Other {specify: : ,) 



Emphasis in Your 
In-Service Education' 



No 
Emphasis 



Great 
Emphasis 



1 2 3 4 5 6 7 
1 2 3 4 5 6 7 



Value for Teachers 



No 
Value 



Great 
Value 



4 
4 

4 . 
4 
4 
4 



iC 6. (Adm. Gd., 26; Dir. Ques., 38) Categories of staff that should and do perform the main roles in planning and 
conducting in-service education (e.g., setting objectives, appraisal of needs, selecting and organizing learning 
activities, evaluation), and what their typical roles should be and are: 



A. 

Staff That Should 



B. 

Staff That Do 



Intended Roles Actual Roles 



I 7. (Adm. Gd., 27) Number of days per year that staff members should devote to participation in in-service 
education (if none, so indicate): 

Subsequent 
First Year Years 

a. Teachers and counselors days days 

b. Aides days days 

c. Supervisors and administrators days days 

d. Others (specify: ) days days 

I 8A. (Adm. Gd., 28) Incentives that should be used to encourage participation in an in-service education program 
(e.g., released teaching time, extra pay, required attendance): 

C 8B. (Dir. Ques., 37) Incentives thai are used to encourage participation m your in-service education program 
(check all that apply): 

Released time from regular duties 

Extra pay > 

Condition of continued employment (attendance required) ' 

____ Other (specify: ... : — - ) 
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C 9. (Dir. Ones., 25) Arc new staff members regularly assigned to work with experienced staff members who do 
the same kind of work? 

Yes No 



C 10. (Dir. Ques., 26) If yes, give the special conditions of employment that are involved during this iniiial 
period (e.g., duration of assignment, full or part pay, union requirement): 

C 11. (Dir. Ques., 27) Value of such an assignment for enhancing staff performance: 

Little Value Great Value 

. .1. 2 3 ^1 5 6 7 

C 12. (Dir. Ques., 28) Special problems, if any, related to this practice: 

C 13, (Dir. Ques., 29) is this form of in-service education much different for teachers than for other calogories 
of ABE staff?. 

Yes ' No ' ^ 



C 14. (Dir. Ques., 30) If yes, describe the distinctive ways in which this form Is used for teachers: 

C 15, (Dir. Ques., 31) Do you consider staff participation in curriculum development Ti planned compoi ont of 
your in-service education effort? 

, Yes . No 

C 16. (Dir. Ques., 32) If yes, what special conditions pertain (e.g., released time, extra pay, required of all)? 



C 17, (Dir. Ques., 33) Number of days per year, on the average, that each staff member devotes to this 
practice: 

Days 

C 18. (Dir. Ques., 34) Special problems, "if any, attendant on this practice: 

C 19. (Dir. 0«-'es., 35) Is this form of in-service education much different for teachers than for other o^jcjpries 
of ABE staff? 

^.^ Yes No 

C 20. (Dir. Ques., 36) If yes, describe the distinctive ways in which this form is used for teachers: 

C 21. (Teach. Ques., 31) Number of days in past year that teachers have participated in organised in-service 
education activities: 

^ Days 
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IC 22. (Teach. Ques. 32) CoiKcrnlng prc-scrvicc and in-service training for aides and volunteers: 

Al. 5/70d//c/ they receive Bl. /-/cfve they received 

such training? such training? 



Yes 



No 



Yes 



No 



A2. If yes, should teachers 
also attend these 
training sessions? 



B2. If yes, did teachers 
attend these 
training sessions? 



Yes 



No 



Yes 



No 



I 2ji. (Adm. Gd., 29) Administrators* expectations about the ways in which staff members (especially teachers 
and aides) Nvill become more competent as a result of in-service education: 

IC (Adm. Gd., 30; Teach Ques., 33; Dir. Ques., 39) Extent to which each of the following should be and Is 

a major ou.tcome of in-service education: 



A. Higher staff morale 

b. Greater insight into students 

Increased professlon.\l competence 

d. Creator recepiivity lo juiure in-service 
education 

6". IncreJ5ed compcxciKQ o\' i Miners . . . . 



A. Should Be a Major Outcome 

Little or 
No Extent 



B. Is a Major outcome 



2 3 4 
2 3 4 
2 3 4 



Great 
Extent 

6 7 
6 7 
6 7 



Little or 
No Extent 



2 3 
2 ' 3 
2 3 



Greai 
Extent 

6 7 
6 7 
6 7 



25. (Adm. Gd., 31) Suggestions for improving in-service education for your staff: 
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Summary of Data About the Content of In-Service Education 
from the In-Service Education Content Form 



The form below can be used to summarize data collected from administrators, teachers, and aides by means of the 
In-Service Education Conieni Form. One way to do this Is to circle each number on the filled-out forms, and under 
each circled number to write the total nurhber of administrators, teachers, and aides who circled it. If desired, code 
letters could be used to indicate who did the circling. Thus, two administrators, three teachers, and four aides could 
be indicated by writing 2A, 3T, and 4a under the appropriate circled items. 



Past Emphasis on 
In-Service Education 



Current Priority for 
In-Service Need 



Topics 

a. ABE program orientation: objectives, 

procedures, current developments, 

plans, reports 

b. Differences in te^iching adults and 

children 

c. Philosophy of auuii education 

d. Understanding the student population, 

culture of poverty, ethnic group 
differences 

e. Course orgartization: content selection, 

scheduling and sequencing topics, 
making lesson plans 

f. Methods of instruction: selecting, 

adapting, and using. 

g. Instructional materials and aides: 

selecting, adapting, and using 

h. Diagnosis of student _needs, testing and 

evaluating achievement; student 
program prescription 

i. Discipline, class control, management of 

student failure, coping with lack of 
self-confidence 

j. Counseling students in academic or 
personal matters 

k. Working with aides and volunteers 

!. St-jdc.nt reciuitment and retention 

m Individualizing instruction 

n. Improving human relations: 
teacher-student 

o. Improving staff relationships within ABE 

p. Teaching "coping" skills: skills of urban 
living 



None 



2 3 

2 3 

2 3 

2 3 

2 3 

2 3 



Great 



2 3 4 5 6 7 
2 3 4 5 6 7 



2 3 4, 5 6 7 

2 3 4 5 6 7 

•2 3 4 5 6 7 

2 3 4 5 6 -7 



5 6 

5 6 

5 6 

5 6 

5 6 

5 6 



Low 



High 



2 3 4 5 6 7 

2 3 4 5 6 7 

2 3 4 5 6 7 

2 3 4 5 6 7 
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Instruction 



Instruction is the central component in the ABE unit. It includes various activities directly associated v^ith the 
teaching-learning process. The most familiar form of instruction occurs in a classroom setting in v^hich an ABE 
teacher, sometimes with the assistance of an aide, works with a group of between eight and twenty-five adult 
students. Insiruclioiir may also take the form of individual tutoring, sometimes in a student's hcMTie, or ihc highly 
individualized activiries of a learning laboratory. Some classes may be departmentalized, as when a teacher works 
with the adult students on math during one session, and a second teacher works on language arts during another. 

The main influences on instruction are students, teachers, materials, facilities, and goals. These are the results of 
recruitment, staffing, and other components of the program. Consequently, the major evaluation items for these 
influences on instruction are located under other program, components. 

The instructional process consists basically of students engaging in learning activities, usually with the assistance of 
teachers and aides. Characteristics of the instructional process include subject-matter emphasis, methods of instruc- 
tion, functioning of the learning lab, teacher activities, aide activities, the counseling function, and the evaluation 
process. - 

The main outcomes of instruction are student attainments, such as persistence, in trying to learn, achievement, 
further education, and occupational development. 

Data for Evaluating the Instruction Process 

Each of the following items seeks information that accurately describes the part of your program related to 
instruction. The letters in the left margin indicate whether an item is seeking information on (I) intended practice, 
(C) current practice, or (IC) both. If there is no letter, the item is general. Parallel items of intended and current 
practice are listed as A and B of the same number for easy comparsion. 

All items are cross-referenced to corresponding items in the evaluation instruments. The cross-reference is in 
parentheses following the item number. It gives the name of the instrument (abbreviated) and the number of the 
corresponding item in that instrument. The page numbers of the instruments are listed on the Contents page. 

C 1. (Prog. Stat. Form, 5) Number of teachers employed: 

C 2. (Prog. Stat. Form, 6) Number of: 

Part-time teachers (less than 20 hours per week) 

Full-time teachers (20 or more hours per week) 

C 3. (Prog. Stat. Form, 7) Annual rate of teacher turnover: 

a. 25% or more b. 10-24% c. less than 10% 

C 4. (Prog. Stat. Form, 8) Number of classes currently in operation: ^ 

C 5. (Prog. Stat. Form, 9) Number of classes that are: 

ESL (Eng. as sec. lang.) ; . . _ 

Basic education (native born) 

Mixed : 

GED (H.S. equiv.) 

Other (specify: ) 
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C 6. (ProK. Slat. Form, 10) Number of classes held: 

In public school racilitics 

In other locations 

C 7. (Prog. Stat. Form I I) Number of classes held: 

During the day (before 5 p.m.) 

In the evening (alter 5 p.nV.) 

C , 8. (Prog. Stat. Form 12) Minimum enrollment required Tor a class to continue: 

C 9. (Prog. Stat. Form, 13) Number of hours per week thai classes usually meel: ■ 

C 10. (Prog. Stat. Form 14) Current operating budget: 

iC II. (Teach. Ques., 5; Dir. Ques., 40) Sources of classroom instructional materials: 

A. Percentage B. Percentage 

That Should Be That Are 

.1. Conimerejally published % % 

b. Prepared or adapted I'V teacher % % 

e. Prepared or adapted locally % %■ 

IC 12. (Adm. Gd. 32; Dir. Ques., 47) How ABE classroom facilities should be and are distributed between types of 
locations: 

A. Should Be B. Are 

a. Adult education center used for clustered 

classes iiiiy and eveninj; % .. % 

b. Scattered classes in school buildinss, alter 

school % % 

c. Scattered outreacli classes in facilities of co- 
sponsors ■ :__ % % 

d. Other (specify): ) % % 

Total = 100% • 100% 

IC 13. (Teach. Ques., 6; Adm. Gd., 33; Dir. Ques., 48) V^ho should have and does have responsibility for orienting 
new students: 

A. Should Have B. Does Have 

Staff Member Responsibility Responsibility 

a. Director 

b. Teacher 

c. Lab instructor ^ 

c. Counselor 

c. Aide 

f. Other (specify: ) : 



o 
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IC 14. (Teach. Qucs., 7; Adni. Gd., 34; Dir. Ques., 49) How an entering student's achievement level should be and 
and/s ass&sed: 

A. Should Be B. Is 

Assessment Method Assessed By Assessed By 

\ 

.1. . SuuuidrcJi/ed test .* ' 

b. Locally developed test 

c. I nierview , 

d. Combirvitlon o< above ' ^ 

e. No assessment 

f. Other (specify: ) 

!C 15. (Teach. Ques., 8; Adm. Gd., 35; Dir. Ques., 50) V^ho should and does make the initial assessment of student 

skill levels: v 

A. Should Make B. Does Make 

Staff Member Assessment Assessment 

.1. No one ^_ 

b. Counselor , 

c. Director " 

d. Teacher . 

Aide 

f. Lab instructor 

g. Other (specify: ) 

IC 16. (Teach, Ques,, 9; Adm. Gd., 36; Dir. Ques., 51) When diagnostic placement tests 5/7ow/dy £re and are adminis- 
tered : 

A. Should Be B. Are 

Adipinistered Administered 

a. Never - ■ ' 

b. At the time of enrollment • 

c. After enrollment, when 

student is ready 

IC 17. (leach. Ques.. 10; Adm. Gd., 37; Dir. Ques., 52) How student progress should be and Is evaluated: 

A. Should Be B. Is 

Evaluation Method Evaluated Evaluated 

a. Classroom tests 1 

b. Standardized • • 

achievement tests 

e. Teacher summary 

evaluation 

d. Staff conference 

e. Combination of above '. 

f. Other (specify: _) 

IC 18. (Teach. Ques., II; Adm. Gd,, 38; Dir. Ques., 53) Records of student progress in the ABE program that should 
be and are kept on file: 

A. Should B. Are 
Be Kept Kept 
S tudent Records 

' a. Classroom test scores 

b. Standardized test scores 

c. Teacher evaluations • : 

d. Other (specify: ) 
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IC 19. (Adm. Gd,, 39;" Dir. Qucs., 54) Uses to which student records (from regular classes, learning lab, other 
sources) should 6c? and t/''^^ put: 

A. Should Be B. Are 

a. Measure student progress in program 

b. Place students In classes 

~ Counsel students 

. d. Re/cr sludcnis to other programs, employers, etc. 

c. Othor (cnnrlfy } 

IC 20. (Adm. Gd., 40; Teach Ques. 12) If standardized achievement tests are w^cd should they 6e iind are they 
administered at regular intcrViils? 

A. Should Be B. Are 

Yes _Yes 

No No 

IC 21. (Adm. Gd., 41; Teach Ques., 12A; Prog. Stat. Form 15A) //"ye^*, at what intervals s/70i//c/ they be and c/rt? 
they administered: 

A. Should Be B. Are 

a. 1 00 hours of instruction 

b. 150 hours of instruction 

c. 200 hours of instruction 

d. Other (specify: '. ) 

C 22. (Prog. Stat. Form, 15B; Teach Ques., 12B) 

■ Names of standardi/:ed tests used: . = 



(Note: If results of these tests have been analyzed for your use, attach copy.) 
IC 23. (Teach. Ques., ]4; Dir. Ques., 41) Emphasis that 5/70i^/G^^^ and /5 given to various ABE subjects: 



A. Should !3c Glvsn 



B. Is Given 



ABE Subjects 

a. Arithmetic 

b. Reading, language skills 

c. Health education 

d. Consumer education . 

e. Social studies, civics 

f. Ethnic or racial heritage 

g. Coping (how lo apply for a job, obtain legal 
assistance, deal with landlords) 

h. Other (specify: _ . ) 



Little or 
No Emphasis 



Great 
Emphasis 



7 
7 

\l 

! 

7 
7 
7 

7 
7 



Little or 
No Emphasis 



Great 
Emphasis 
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IC 24. (Teach. Qucs., 15) Peiconiagc of class lime intended to bo and actually devoicd lo each of these 
methods of instruction: 



A. Intended Percentage of Class Time, 



Class 


Type 
of Class 
(e.g., ESL) 


Number 
of 

Students 


Teach 
Class as 
a Whole 




Teach 
Students 
in Groups 




Teach 
Students 
Individually 


=\ 






% 




% 


+ 


.. % 


±2 








+ 


% 


+ 


% 


~3 






% 


+ 


,, % 




.... % 


SI 






% 


+ 




+ 


% 










B. Actual Percentage of Class Time 




Class 


Type 
of Class 
(e.g., ESL) 


• Number 
of 

Students 


Teach 
Class as 
a Whole 




Teach 
Students 
in Groups 




Teach 
Students 
Individually 


iq 








+ 


% 


+ 


% 








% 


+ 


■ % 


+ 


% 








. .% 


+ 


% 


+ 










.... . % 


+ 




+ 


% ■ 



100% 
100%^ 
100% 
100% 



100% 
100% 
100% 
100% 



25. (Teach. Ques, 16) Do teachers adapt iheir mn^hods of instruction to accommodate differences among 
students? 



Yes 



No 



IC 



(If yes, fill in B part of item 26; if no, leave B part of 26 blank) 

26. (Teach. Ques., 16) Emphasis that should be and is placed on methods of Instruction to accommodate 
differences among students: 



Methods of Instruction 

a. Porsonally tutor individual students 

Group students with similar problems or 
inle rests together 

c. Send student to learning lab 

d. Make individual reading, writing, or math 
assignments 

e. Use programmed material 

f. Other (specify: - ) 



A. Should Be Placed 



Little or 
No Emphasis 



Great 
Emphasis 



B. Is Placed 



Little or 
No Emphasis 



Great 
Emphasis 



6 
6 

6 
6 
6 
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IC 27. (Teach. Ques., 17; Dir. Ques., 42) . Extent to which students 5/?©^//^/ and do participate in various ways in 
their instruction: 

A. Should Participate B. Do Participate 



Type of Participation 

a. Student recites 

b. Pairs or small groups of students practice 
skills together 

c. Small groups engage in problem solving . . . 

d. Whole class participates in discussion 

e. Small groups engage in discussion 

f. Students ask questions 

g. Real or simulated learning situations (e.g., 
case studies, role playing) 

h. Planning or evaluating this educational 
program 



Little or 
No Extent 



Great 
Extent 



Little or 
No Extent 



4 
4 
4 
A 
4 

4 

4 



4 
4 
4 
4 
4 

4 

4 



Great 
Extent 



C 28. (Teach. Ques., 18) Are there aides or volunteers who work with teachers in their classrooms? 

Yes No 

(If no, skip to item 32) 

IC 29. (Teach. Ques., 19; Dir. Ques., 43) Percentage of time of teacher's aide or volunteer should be and is 
spent performing the following duties: 



Duties 

a. Clerical 

b. Housekeeping. 

c. Child care . . . . 

d. Instructional . 

e. Other (specify: 



-) 



A. Should Be 

% 

% 

% 

% 

% 



B. Is 



IC 30. (Teach. Ques., 20; Dir. Ques., 44) Percentage of the aide's or volunteer's instructional time th^l should be and 
is spent working in the following ways with students (//" the aide or volunteer performs in an instructional 
role); 

B. Is 



a. Individual tutoring , 

b. Working with small groups . 

c. Teaching class as a whole . , 

d. Other specify: 



A. Should Be 

% 

% 



) 



Jit 



_% 



Total ^ 100% 100% 

IC 31. (Teach. Ques., 21) How important the teacher's aide or volunteer sAow/^/ Z^e and is to the educational 
effectiveness of the classroom (if the aide or volunteer performs in an instructional role): 



A. Should Be 



B. Is 



Not 
Important 



Very 
Important 



Not 
Important 



Very 
Important 



12 3 4567 123 ...4 '567 

!C 32. (Teach, Ques., 22; Dir. Ques., 45) How important to the teacher's role as teacher \i should be and/> to help 
students with personal and vocational problems: 



A. Should Be 



B. Is 



Not 
Important 



Very 
Important 



Not 
Important 



Very 
Important 



o 
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IC 



33. (Teach. Qucs., 23) Number ol students the teacher should talk with privately in a typical month and did 
talk with privately last month about their personal and vocational problems: 



Number of Students 



A. Should talk with 

B. Did talk wilh 

C 34. (Dir. Ques., 55) Is any part. of the instruction provided in your program individualized-that is, individu- 
ally prescribed and placed? 

Yes No 



C 35. (Teach. Ques., 24; Dir. Ques., 56) If yes, is such instruction provided in a more or less self-contained 
learning lab (a separate instructional facility using programmed materials and in some cases instructional 
equipment designed to enable students to work individually at their own pace)? 

Yes No 



C 36i-.(Dir. Ques., 57) If you have a learning lab, name of supervisor: 

IC 37, (Teach. Ques., 24; Adm. Gd., 42; Lab. Sup. Gd., 1) Part a learning lab should and does play in your 
instructional program: 



A. Should B. Does 

a. Used for rcmedia! work for students re- 
ferred by teacher 

b. A regular part of the students' total program _^ 

c. Available to students who want it _^ — 

d. None _^ — 

e. Other (specify: '. — ) ^ 

IC 3S. (Teach. Ques., 25; Adm. Gd., 43; Lab. Sup. Gd., 2) How the student's work in the should be and /s 
coordinated with classroom instruction: 

A. Should Be B. is 

a. Student's lab work prescribed by teacher . . ,. . 

b. Student's lab work prescribed by counselor 

c. Student's lab work prescribed by lab in- 
structor 

d. Conference between teacher, lab instructor, 

and/or counselor 

e. Not coordinated in any specific way .■ , : 

IC 3^'. (Adm. Gd., 44; Lab. Sup. Gd., 3) Categories of staff that should be and are associated wilh the learning lab, 
and what their duucs should' be and are: 

A. Should Be 
Staff — Duties ^ 



B. Are 

Staff Duties 
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IC 40. (Adm. Gd., 45; Lab. Sup. Gd., 4) How frequently the student in the learning lab should and does have 
contact with each category of staff member: 



A. Should B. Does 



IC 41. (Adm. Gd., 46; Lab. Sup. Gd., 5) How these contacts stowM be and are initiated (e.g., staff circulating in 
the lab, staff stationed at desks available to students when students want help): 

. A. Should Be Initiated B. Are Initiated 



IC 42. (Adm. Gd., 47; Lab. Sup. Gd,, 6) Sorts of help the staff should and does give students in the learning 
lab: 

A. Should Give B. Does Give 



IC 43. (Adm. Gd., 48; Lab. Sup. Gd., 7) How student progress in the learning lab should be and is recorded; 

kind of information that should be and is kept; who should and does keep it; and to whom it should be 
and is available: 

A. B. 
Should Be Recorded Is Recorded 



Should Be Kept fs Kept 



Who Should Keep Who Does Keep 



To Whom Should Be Available To Whom Is Available 



C 44. (Class. Int. Form, 1) Extent to which teachers plan class learning activities in advance: 



Seem Not Seem to Plan Seem to Lay Out 

To Plan Major Objectives Every Step 

at All But Not Details In Advance 

1 2 3 4 5 6 7 
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C 45. (Class. Int. Form, 2) Rating of classrooms from controlled and regulated (students participate only when' 
clearly expected or required to) to open and free (students talk spontaneously to teacher and among 
selves): 



Controlled Open 



12 3 4 5 6 7 

46. (Class. Int. Form, 3) How attentive teachers seem to b<t to the needs of students for help in their learning 
activities: 

Completely Very 

Inattentive Attentive 



12 3 4 5 6 7 

C 47. (Class, Int. Form, 4) Effort that teachers make to accommodate the interests and feelings of students: 

No ContinuaJ 
Effort Effort 



48. (Class. Int. Form, 5) Extent to which teauiefs evoke participation in learning activities intended for the 
class as a whole: 

Seem Unable Evoke 

to Evoke Enthusiastic 

Participation Participation 



12 3 4 5 6 7 
49. (Class. Int. Form, 6) Extent to which students remain attentive to classroom activities and work steadily: 

Consistently Attention Wanders, 

Attentive, Little Time 

Work Steadily Spent Working 



1 2 3 4 5 6 7 

50. (Class. Int. Form, 7) To what extent teachers treat students as adults rather than as children or adoles- 
cents: 

As Children 
or Adolescents As Adults 



1 2-3 4 5 6 7 

51. (Class, Int. Form, 8) How formally or informally teachers conduct classes: 

Quite Very 
Informally Formally 



52. (Class. Int. Form, 9) How frequently teachers make encouraging remarks to students or act in some other 
positively reinforcing way to them: 

Never Give At Every Chance 

Positive Give Positive 

Reinforcement Reinforcement 

I 2 3 4 5 6 7 
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53. (Class. Int. Form, 10) Extent to which teachers are sensitive to the student's fear of failure when 
evaluating his pcrrormancc: 



No Regard For Greatly Sensitive to 

Student's Feelings Student's Feelings 



I 3 4 5 6 7 

54. (Class. Int. Form, 11) Extent to which the physical setting. of the class is distracting (lighting, dirt, 

outside noise, etc.): 

Typical 

Few or No Classroom A Great Many 
Distractions Distractions Distractions 

12 3 4 5 6 7 

55. (Class. Int. Form, 12) Extent to which teachers and students understand each other: 

Almost Always De«p and Complete 

Seem to Be Understanding 
Taiking Past of What Each 

^■^ Each Other ■ Is Saying 



12 3 4 5 6 7 

C 56. (Stu. Oues., 4) Do students feel they are treated like adults? 

Yes No 

C 57. (Stu. Ques., 5) Do students feel the classes are relaxed and friendly? 

Yes No 

C 58. (Stu. Oues. 6) How students judge difficulty of learning in these classes: 

Very Hard. Having a lot of trouble. 

Sometimes hard, but not too much trouble. 

Not hard. No trouble. 

IC 59, (Teach. Ques., 26; Dir. Ques. 46) Goals of the program ranked (1, 2, etc.) according to their importance 
to the teachers and the director, and according to the degree of emphasis actually placed on them: 

B. Rank of 

A. Rank of Actual 

ABE Goals Importance Emphasis 

- A. Increased scH-confldcncc of students 

b. Completion of 8th grade equivalency 

c. Increased competency in language skills . . . 

d. Preparation for high school equivalency 



exam 

e. Increased ability to cope w adull-Hfe 
roles and problems 

f. Prepare students to iT>cet special short-term 
i>oals (e.g., complete job application) 

g. Other (specify: _ ) 
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C 60. (Stu. Oues., 1) The one most important reason sludcnls give for coming to adull education classes: 



To be able to help my children with their schoolwork 

To get a job or a bolter job - 

To learn the English language 
To get a high school equivalency diploma 
To improve myself by learning more 
Other-not listed above 



C 61. (Stu. Ques., 2) If the answer to the last question was ''Other/' what was the reason? 

C 62. (Stu. Ques., 3) How much the classes are helping the student in regard to his most important reason for 
attending them: 

Not helping at all 

Helping some, but not enough 

Helping a lot 

IC 63. (Adm. Gd., 49; Teach. Ques., 13, 27; Dir. Ques.^ 58) Expected and actual gain in grade level for typical 
students at the beginning, intermediate, and advanced levels for every 100 hours of instruction: 

A. Expected B. Actual 

a. Beginning 

b. Intermediate 

c. Advanced 

C 64. (Teach. Ques., 28) Approximate percentage of enrolled students who are absent at any one class meeting: 

less than 10% 10-24% 25-49% 50% or more 

C 65. (Dir. Ques., 59) How satisfied are you with the extent to which yi-^ur instructional program enables 
students to: 

P Not Very 

Satisfied Satisfied 

Get a job 1 2 3 4 5 6 7 

Go into a job-training program 1 2 3 4 5 6 1 

Go on to further education 1 2 4 5 6 7 

Achieve personal goals 1 2 3 4 5 6 7 

Achieve educationally 1 2 3 4 5 6 7 
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66. (Adm. Gd., 50; Teach/ Ques., 29; Stu. Ques., 7) Suggestions for improving instruction: 
Administrators' Suggestions 

Teachers' Suggestions 



Students' Suggestions 
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Collaboration 



The iwo most common examples of coliaboralion between an ABE program and other community organizations arc 
the co-sponsorship of classes and the referral of students. Referral is a two-way street. Community organizations ..Ihai. 
do not have basic education programs of tlieir own refer clients who need basic education to the ABE program. 
Conversely, ABE programs often refer siudenls who need such services as child care, transportation, and job placement 
to community agencies that arc better equipped to perform these services. 

If an ABE program is to collaborate with other community organizations^ it must allocate time and money for 
that purpose. It must also develop ways of establishing and maintaining contact with those organizations. The 
director may assume primary responsibility for this or may delegate it to liaison staff. Some directors prefer to 
rely on contacts made with other organizations at meetings and conferences. Other directors supplement such 
contacts with the use of mass media, community liaison personnel, and other methods. 

There are several advantages of collaboration, it may enable ABE programs to diversify the locations of their 
classes at minimal cost and to increase the number of students they serve, it may also enhance program prestige, 
Increase the visibility of the program to the community, and establish a more secure institutional position for the 
program in the community. 

Recruitment is the major program activity most closely related to collaboration. Referral agencies are often a source 
of students. Co-sponsors help boost recruitment, too. They not only attract students, but also provide facilities for 
outreach classes. The co-sponsoring of classes affects other program activities as well as recruitment, namely instruction 
and sometimes even staffing. Goal-setting is related to collaboration in several ways. The goals that are set provide 
criteria for establishing and modifying collaborative arrangements. Also, the working relationships between agencies can 
influence goal-scttlng. 



Each of the following items seeks information that accurately describes the part of your program related to 
collaboration. The letters in the left margin indicate whether an item is seeking information on (I) intended 
practice, (C) current practice, or (IC) both. If there is no letter, the item is general. Parallel items of intended and 
current practice are listed as A and B of the same number for easy comparsion. 

All items are cross-referenced to corresponding items in the evaluation instruments. The cross-reference is in 
parentheses following the item number. It gives the name of the instrument (abbreviated) and the number uf the 
corresponding item in that instrument. The page numbers of the instruments are listed on the Contents page. 



IC 1. (Adm. Gd., 51; Dir. Ques., 60) Proportion of your ABE budget and of your administrative, time that 



Data for Evaluating the Collaboration Process 




should be and is allocated for collaboration: 



A. Should Be 



B. Is. • 



a. Budget 
' b. Administrative time 



.% 



J/o 
J/o 



2. (Adm. Gd., 52) Types of organizations preferred as co-sponsored and sources of referral and support: 



3. (Adm. Gd., 53) Types of working relationships desired with collaborative organizations: 



C 



4. (Dir. Ques., 61) During the past year, have you employed staff members whose primary responsibility is 
to act as a liaison between the ABE program and the community? 



Yes 



No 



If yes, how many (full-time equivalent)? 
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C 5. (Dir. Ques., 62) If yes to #4, importance of these liaison functions for your 
program: 

Rai.;.. .n Order 

Liasion Functions of Importance 

a. Recruiting students 

b. Following up dropouts 

c. Providing feedback on the success of the 

ABE program in the community 

d. Establishing co-sponsorship ^ 

e. Other (specify: ; 

C 6. (Dir. Ques., 63) Have you and your staff experienced any major conflicts or problems in working wilh other 
organizations that co-sponsor classes, refer students, or sponsor their own basic education classes? 

Yes No 

C 7. (Dir. Ques., 64) If yes, describe the major problems in working relationships and why they seem to occur: 

j» 

C 8. (Dir. Ques., 65) Extent to which your program experienced difficulty during the past year in establishing 

contact with potential co-sponsors and with agencies that refer students: 

Little or Great 
No Extent Extent 

1 2 3 4 5 6 7 
C 9. (Dir. Ques., 66) Reasons for terminating co-sponsored classes: 

Rank in Order 

Reason for Termination of Frequency 

a. Enrollment declines below the minimum 

needed to continue class . " 

b. The educational needs of the co-sponsor * 
are met and classes are no longer needed . 

c. A teacher cannot be found to instruct the 

class 

d. The co-sponsor makes demands on the 

program that are too costly to meet ..... 

c. Other (specify; ) 
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10. (Adm. Gd., 54; Dir. Ques. 67) Imporiance of benefits thai your ABE program is trying to attain and actually 
rece/ues as a result of co-sponsorship of classes and collaboration with agencies that refer students: 

^ Rank in Order of Importance 

A. Trying to B. Actually 

Uencfils of collaboration Attain Receives 

.\. Rccruilmenl of sludenis lhroui;h co-Sponsorcd classes .... \ 

b. Provisions of support services (e.g., child care, counseling, 

iransporlalion) by collaborating organization . . 

c. Extension o{ AUli to hard-to-reach segments of the target 

population through co-sponsorcd classes ' 

d. Increased public awareness of program through co-sponsor- 
ship and collaboration wilh referral agencies 

e. Obtaining additional operating funds through ^ .^^ 
co-sponsorship arrangements 

f. Provision of feedback about program through interaction 

with collaborating organizations ^ 

g. Increased community support for A Bti through 

collaboration with other organizations ' 

1 1. (Adm. Gd., 55) Benefits other than those listed above that your program is expectedno attain from coUabo- 
raiion (list briefly): 



fC 12. (Adm. Gd., 56; Dir. Ques., 68) Disadvantages of collaboration that seem most important to avoid and that 
actually were greatest: 

Rank in Order of Importance 

A. Most Important B. Actually Were 
Disadvantages of Collaboration To Avoid Greatest 

a. Loss of program flexibility as a result of collaboration .... 

b. Decrease in administrative autonomy as a result of 

collaboration ' 

Collaboration results in serving students not representative 
'^f of the target population program is trying to reach 

d. I ncrcase in unit cost (instructional hour) as a result of 

collaboration 

c. More of your time than is desirable spent on arranging for 

and administering collaborative efforts 

I 13. (Adm. Gd., 57) Other disadvantages thai you try to avoid related to co-sponsorship or collaboration with 
agencies thai refer students (list briefly): 



14. (Adm. Gd., 58) Suggestions for improving collaboration wilh organizations that co-sponsor classes and 
refer students: 



Information from the Co-Sponsor Data Form 

The following information is to be obtained for each organization with which your program co-sponsors ABE classes. 
For pioi'irams with many co-sponsorship arrangements, a representative sample of such organizations will do. 

I. Name of co-sponsoping organization: 



2. Type of organization (e.g., church, 
hospital, prison) 
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3. Number of ABU classes currently co-sponsored with this organization 
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4. Number of months that classes have been co-sponsored with this organization : 

5. Number of students currently enrolled in classes so co-sponsored 

6. Types of classes co-sponsored with this organization: 

English a.s a Second Language 

Basic Education-native born (levels 0-8) 

GED (levels 9-12) ^ 

7. Compared to typical ABE classes that are not co-sponsored, the class or classe:- co-sponsored with 
this organization: 

Less Time More Time 

.1. Required more or less of the director's adminisiralivc lime 

lo establish 1 2 3 '\ S 6 7 

b. Require more or less of ihc director's attention on a day-io- Less Attention More Attention 
"-'y"-'^'^ • -y-x ; 1 2 3 ,4 5 6 7 

c. Cost more or less in terms ol' \^ Cost Less Cost More 
cosi-per-student 1 2 3 4 5 6 7 

d. Have a more or less favorable Lesa Favorable More Favorable 
retention rale 1 2 3 4 5 6 7 

e. Are more or less representative ol target population Less Representative N>s^ More ^epf^gsetitative 
program is trying to reach ? 2 3 4 6 7 

f. Enhance or detract from the program's Detract from Enhance 
visibility in the Visibility VisibiHty 
community • 1 2 3 4 5 6 7 

More Difficult Less Difficult* 

g. Are easier or more dilficuli to Staff to Staff 

to staff 1 2 3 4 5 6 7 

Detract from Promote 

h. Promote or detract from Support Support 
community support for ABE 1 2 3 4. 5 6 7 

8. Extent to which it has been necessary to modify instruction in classes co-sponsored with this orga- 
nization in order to meet special needs: 

Little or Great 
No Extent Extent 

12 3 4 5 6 7 

9. Does this co-sponsor provide services that support classroom instruction such as child care, transp..* - 
tation of students, counseling, or spbcial incentives for students to attend classes? 

Yes No 

i . . 

,IQ. If yes, briefly list services or incentives: 

T1. importance to co-sponsor organizatibri of the services provided by. the ABE program: 



Little or 
No importance 



Great . . 
Importance 
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Information from the Co-Sponsor QuL'^tionnaire 

1. Name of or^nization: 

2. Organiz>.. ion's business, purpose, or function: ^ 

3. Position in the organization of person . supplying data: 

4. Extent to which he was personally involved in establishing ABE classes in his organization: 

Was Not Was Greatly 

involved Involved 

1 2 3 4 5 6 7 

5. Extent to which the organization is involved in the day-to-day operation of ABE classes: 

Is Not Is Greatly 

Involved Involved 

1 2 3 4 5 6 7 

6. How the organization determined that it needed ABE classes: . 

An investigation of employee or membership records indicated a large number of undereducated 

adults. 

■ The organization's employees, membership, or clients requested ABE classes. 

The organization felt a need to upgrade employee skills. 

The organization contains a significant number of non-English speaking adults. ABE was needed 

to facilitate communication. 

The organization had not considered ABE, but the ABE director or his representative convinced 

them that it was a good idea. 

■ Other (specify) 



7. How the organization first learned of the ABE program: 

8. )f an employer, does the organization offer its employees released time from work with pay to attend ABE 
classes? 

_yes ^No ■ Not an employer 
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9. Success ol" ABE classes in accomplishing the following for ihc organization: 



Unimportant 

for the 
Organization 



ABE Ciasscs 
Have Had 
No Success 



Upgrading employee, member, or clieni skills 

Increasing employee, client, or membership 
proficiency in speaking English 



Increasing morale and building an esprit de 
corps among members, clients, or employees 

Giving members, clients, or employees the 
opportunity to rise within the organization 



10. Ways in which Ihc ABE program most benefited the organization: 



ABE Classes 
Have Been a 
Great Success 



5 6 7 

5 6 7 

5 6 7 

5 6 7 



1 1 . hiave there been any significant drawbacks to co-sponsoring classes with the ABE program? 

Yes No 

12. If yes, list: - 



13. When problems arise concerning ABE classes, the co-sponsor usually contacts: 

The ABE Director The Teacher 

Other (specify: ) 

14. Co-sponsor's rating of the effectiveness of the ABE teacher: 

Ineffective Very Effective 



12 3 4 5 6 7 



Unable ■ 
to rate 

teacher's effectiveness 



15. In general, how satisfied with the ABE classes are the adults from the organization who participate in them? 
Unsatisfied Very Satisfied 



1 2 3 4 5 6 7 



No adequate 
knowledge o5 
their satisfaction 



16. Why the organization chose the ABE program to provide basic education classes for its members, employees, 
or clients: 

Belief that the ABE program is the best available program providing basic education in the 
community. 

The ABE program provides its service free of charge. 

The ABE program was the only basic education program the organization knew about. 
The members, clients, or employees wanted it. 

Other (specify: . ' ) 



17. Additional comments: 
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Goal-Setting 



To understand ihc goals of an ABE unit, you must examine not only the stated goals but also the implicit goals. These 
are the goals reflected in the priorities set and policy decisions made on recruitment, staffing, and other facets of the 
program. 

A general goal of ABE units is to help undereducated adults to increase their ability to handle further education and 
perform their adult roles in work, family, and community. More specific program goals relate to characteristics of 
participants, staff, and instruction. In the evaluation of an ABE program, emphasis should be placed on these more 
specific goals and priorities. The very specific goals and objectives of individual students and teachers are dealt with in 
the sections on recruitment and instruction and are not included in this section on goals. 

Goal Setting is influenced by many local factors largely beyond the control of ABE staff n>embers. These factors 
include the provisions of the state ABE plan that Is submitted to the U.S. Office of Education; the characteristics of the 
total population of the service area; assumptions about the expectations of potential participants; and the relationships 
between the ABE program and the remainder of the school system as reflected in policy guidelines and funding 
arrangements. Goal setting is also affected by such imponderables as the characteristics of the people who set the goals. 

An important outcome of the goal-setting process is the preparation or revision of a written statement of program 
objectives. Decisions must also be made about the target population, the recruitment strategy, criteria for staff 
selection, specifications for staff development, and emphasis on various instructional areas. Program goals may be 
reflected in the types of efforts used to obtain community support, in the degree of decentralization of ABE class 
locations, and in the extent of collaboration with community groups. Thus goal setting is intimately connected with 
other components of the program. It affects them and is affected by them. 

Data for Evaluating the Goal-Setting Process 

Each of the following items seeks information that accurately describes the part of your program related to goal-setting. 
The letters in the left margin indicate whether an item is seeking information on (I) intended practice, (C) current 
practice, or (IC) both. If there is no letter, the item is general. Parallel items of intended and current practice are listed 
as A and B of the same number for easy comparison. 

All items are cross-referenced to corresponding items in the evaluation instruments. The cross-reference is in 
parentheses following the item- number. It gives the name of the instrument (abbreviated) and the number of the 
corresponding item in that instrument. The page numbers of the instruments are listed on the Contents page. 

iC 1. (Adm. Gd., 59; Dir. Ques., 69) Persons or groups who 5rtot//^y have and currently o^o have the most influence 
on setting program goals and priorities: 

A. Should Have B. Do Have 



IC 2. (Adm. Gd., 60; Dir. Ques.. 70) Role each person or group typically s/7ad//</ and does play rn the goal-setting 
;^r'^cess: 

A. Should Play B. Does Play 



IC 3. (Adm. Gd., 61; Dir. Ques., 73) How the-working relationship between the ABE unit and collaborative 
organizations 5/70£//(y and does influence the goal-seiting process: 

A. Should Influence B. Does Influence 
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4. (Adm. Gd., 62; Dir. Ques., 71) Extent to which each factor listed bc\o\^ shouid and does influence the goals 
and priorities of your local ABE program: 



Factors 

State ABE plan 

General population characteristics .... 
Other ABE programs in the community 

Expectations of the students 

Relations with school systems 

CED exam 

Expectations of the community . . . . 



A. Influence Should Have 

Little 
or None 



B. Influence Docs Have 



Great 

7 
7 
7 
7 
7 
7 
7 



Little 
or None 



Great 



C 5. (Dir. Ques., 72) Specific ways in which the state plan hasc/c/wc/Z/y influenced goals and priorities: 



IC 6. (Adm. Gd., 63; Dir. Ques. 74) What your ABE unit should and c/oes have by way of a written statement of 
goals: 

A. Should Have B. Does Have 



C 7. 



(Dir. Ques., 75) Policy decisions related to program goals and priorities that have actually been made or 
modified during the past year or so your local ABE program (check all that apply): 

Definition of target population 

_ Selection of student recruitment strategy 

Foimulation of criteria for staff selection 

Determination of relative emphasis on various instructional areas 

Determination of strategies for obtaining community support 

Decision on degree of centralization vs. decentralization of class locations 

Policy related to collaboration with community groups and organizations 

Other (specify: [ ) 
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For each policy decision checked, include the following Information from the Goal-Setting Process Form: 

( 1 ) Subject of policy decision (target population, recruitment, etc.) 

(2) How this issue was resolved: 

(3) Director's role: 

(4) Others involved (individuals and groups): 

(5) Their role: 

(6) Major influences on the resolution of the issue: . 

(7) Efforts made to encourage support for the outcome: 

49 



8. (Adm. Gd., 64) Suggestions lor improving the process of selling goals and prioriiics in your ABE program: 



Part IV 

EVALUATION INSTRUMENTS 

This part of the guide provides ihe insirumenis needed lo coUcci evaluaiion daia. Three lypes of insirumcnis are 
included: interview guides, questionnaires, and forms. 

Evaluation items are grouped together in each instrument according to the source of the data. Thus, the items to 
which teachers will respond in writing are in the Teacher Questionnaire, and the items to which the learning lab 
supervisor will respond orally are in the Lab Supervisor Interview Guide. In general, the items about intended practice 
are contained in. the Guides, and the iterns about current practice are contained in the Questionnaires and Forms. 

These same items, in slightly different form, are grouped in Part III according to their relation to the six selected 
program components. Each item in the instruments is cross-referenced so that the corresponding item in the component 
sections can be easily located. A few of the forms are exceptions; cross-references are not needed since all of the 
information in the form is repeated in one component, which is identified in the form. Thus, all of the items in the 
Co-Sponsor Data Form are repeated with the same numbering in the component on Collaboration. 

There is one copy of each instrument. Additional copies can be made as necessary. The approximate number of 
copies of each instrument required to evaluate a typical program with 500 students is as follows: 



Instrument Copies 

Preliminary Survey Guide 100. 

Administrative Staff Interview Guide 6 

Lab Supervisor Interview Guide 2 

Director Questionnaire 2 

Teacher Questionnaire 40 

Student Questionnaire 500 . . 

Co-Sponsor Questionnaire 5 

Program Statistics Form 4 

Student Data Form 4 

Teacher Data Form 40 

Teacher Rating Form 40 

In-Service Education Content Form 40 

Classroom Interaction Rating Form 40 

Co-Sponsor Data Forni 5 

Goal Setting Process Form 8 
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Interview Guides 



The three interview guides that follow suggest*: questions that interviewers can ask of respondents. Each guide is 
organized to colled data from a specified category of respondents. For instance, the Preliminary Survey Guide is to be 
used with a few key staff members such as the director, supervisor, and several teachers. The Administrative Staff 
Interview Guide is to be used to interview all or a representative sample of ABE administrators. The Lab Supervisor 
Interview Guide is for the lab supervisor. 

If a guide is not entirely satisfactory for a specific ABE program, items should be added, deleted, or modified as 
desired. When modifying instruments, it is important to preserve the parallelism between the interview guide items on 
intended practice and the questionnaire and form items on current practice, so thai comparisons can be made between 
intent and actuality at the data analysis and interpretation stage. 

Preliminary Survey Guide 

Recruitment: Intended Practice 

Each item in this section seeks information about your intents, what you are trying to do whether you are successful or 
not. Terms such ds'shou/d are used in the items for brevity and clarity, but they refer to your serious aspirations and 
intentions, and not some ideal that you do not expect to attain. 

1 . (Rec, 1) What kindi^ -^f staff (e.g., teachers, aides, counselors) should be involved in recruitment activities? 



2. (RvC, 3A) What proportion of your ABE budget and of your administrative time should be alloi^ated for 
recruitment of students? 

a. Budget % 



b. Administrative time % 

3. (Rec, 4) There are many methods that can be used to recruit students (e.g., mass media advertising, dopr-to-door 
canvassing, referral from other agencies, word of mouth). What method should be emphasized in the recruitment of 
students for your programs? 



4. (Rec, 7) What are the characteristics of the target population you are trying to reach (age, sex, ethnic background, 
place of residence)? 



5. (Rec, 9) Given your present resources, what would you like your total current enrollment to be (active students 
at any one time)? 

students 



Recruitment: Current Practice 

Each item in this section seeks information that accurately describes your cwrreA?^ program. Report precise data where 
it is available. Otherwise provide your best estimate. If the format of any item makes it difticult for you to clearly 
describe your program, respond in your own words. 
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6. (Rcc, 3B) Approximately what proportion of your ABE budget and of your administrative time is currently 
allocated for recruitment of students? 



a. Budget % 

b. Administrative time % 

7. (Rec. 5B) Listed at the left of the matrix below are several groups that are often the focus of ABE recruitment 
efforts. Listed at the top of the matrix are a number of recruitment methods. For each group listed, indicate by a 
check mark in the appropriate space(s) in the row to the right, the one or two methods you currently rely on most 
for recruiting persons in that group 



RECRUITMENT METHODS 



Groups 


Door-to 
Door 


Mass Media 


Agency Referral 


Co-sponsored 
Classes 


Word of Mouth 


Other: 


Young adults 














Non-EnKlish Speaking 














Blacks 














Males 














Unemployed 














Least Literate 














Other 














Other 














Other 















8. (Rec, 10) Is your current enrollment as high as budgetary resources will permit? 

Yes No 



9. (Rec, 1 1 ) During the past year, to what extent has your program experienced difficulty in recruiting the kinds of 
students you want to reach?. 

Little or Great 
No Extent Extent 

12 3 4 5 6 7 



10. (Rer., 12) What is your best estimate of the maximum number of po/e;7r/W ABE students in your city or service 
■arcar' . 

11. (Re*.., 13) What is the approximate total number (^students who c6/rre/7r/y participate in your ABE program in a 
i v pica! week? 

12. (Rec, 14) What was your total annual enrollment for each of the past four years? 

Total Annual 
Year Enrollment 



Ljst year 

19 

19 

19 



13. (Rec, 15B) By the sixth week of class, beginning last fall, what proportion of the students who were enrolled at 
li'.o n.'isi week had dropped out of the program? % 
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(Rec, 16) What suggestions do you have about ways to improve the recruitment process in your 
ABE program? 



(Rec.-Stu. Data), If data for the Annual Program Report required by the Adult Education Act of 
1966 are tabulated and current, secure a copy of the report; otherwise, obtain the following data 
from student records, or, in a large program, from a random sample of student records. 

Total number of students or 
total in sample 

1 . By approximate grade level: 

a. Beginning (1-3) 

b. Intermediate (4-6) 

c. Advanced (7-8) - 

d. GED (h!s. Equiv.) 

2. By sex: 

a. Male 

b. Female 

3. By age range: 

a. 17 or less 

b. 18-24 

c. 25-34 

d. 35-44 

e. 45-54 . 

L 55-64 

g. 65 and over 

4. By race: 

a. White 

b. Black . . * 

c. American Indian , 

d. Oriental 

c. Other non-white : 

5. By ethnic group: 

a. Cubans — ■ '■ — 

b. Mexican-Americans 

c. Puerto Ricans * 

d. Other ' 

6. Migrant 

7. Welfare recipients (estimate) 
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Staffing: Intended Practice 

Each item in this section seeks informalion about your intents, what you are tryiitg to do whether you are successful or 
hot. Terms such as should are used ilhe items for brevity and clarity, but they refer to your serious aspirations and 
intentions, and not some ideal that you do not expect to attain. 

16. (Staff., 3) Aside from personality and criteria mandated by state or local regulations, what criteria 5/7 govern 
the selection of ABE teachers (e.g., experience teaching adults, elementary education experience, age, ethnicity, 
pre-service education)? 



17. (Staff., lA) What proportion of your ABE budget and of your administrative imeshou/d be allocated for staffing 
(e.g., setting selection criteria, identifying sources of staff, recruiting staff, selecting and hiring staff, and 



assignment of new staff)? 



a. Budget % 

b. Administrative time % 



18. (Staff., 2A) Who should have the most to say in determining the criteria used in hiring teachers? 



19. (Staff., 13) In overall performance, some teachers and aides are clearly superior to olhers. Realistically speaking, 
about what proportion of your instructional staff do you expect to be: - 

Proportion 

^ Teachers Aides 

a. Excellent ; % % 

b. Very good % % 

c. Good % 

d. Fair % % 

e. Poor. % % ^ 

Total = 100% 100% 

20. (Staff., 12) What would you like the composition of your staff to be in terms of age, sex, ethnicity, and prior 
traininng and/or experience? ^ 



Staffing: Current Practice 

Each of the items in this section seeks information that accurately describes your current program. Report precise data 
where it is available. Otherwise provide your best estimate. If the formal of any item makes it difficult for you to 
clearly describe your program, respond in your own^wbr,^s^^^ 

21 . (Staff., 2B) Who has the most say in determining the criteria used in hiring teachers for your program? 
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22. (Staff., IB) Approximately what proportion of your ABE budget and administrative time Iscurrently allocated for 
staffing (e.g., setting selection criteria, identifying sources of staff, recruiting staff, selecting and hiring staff, and 
assignment of new staff)? 



a. Budget 

b. Administrative time 



23. (Staff., lOB) Who is actively involved in the process of selecting and hiring teachers for your program (check all 
that apply)? 

a. ABE Director 

b. ABE Teachers 

c. School Personnel Office. 

d. ABE Supervisors 

e. Other (specify: 



24. (Staff., lOB) What is the role of each in the staffing process? 



25. (Staff., 18B) What is your annual rate of teacher turnover? 

a. 25% or more 

b. 10-24% 

c. less than 10% 

V 

\ ' ' ' 

25. (Staff.-Teach. Rat. Data) What is the overall performance of your teaching staff? 

1. Poor 2. Fair 3. Good 4. Very Good 5. Excellent 

27. (Staff .-Teach. Data) What is the composition of your present teaching staff in terms of age, sex, ethnicity, prior 
training and experience? 



28. (Staff., 19) What suggestions do you have about ways to improve the staffing process in your ABE program? 



55 



■L 



In-Service Education; Intended Practice 

Each item in this section seeks information about your intents, what you are trying to do whether you are successful or 
not. Terms such as should ;x\ q used in the items for brevity and clarity, but they refer to your serious aspirations and 
intentions, and not some ideal that you do not expect to attain. 

29, (In-Ser, Ed,, 2A) What proportion of your ABE budget and of your administrative time should be allocated for 
in-service education (e.g., workshops, conferences, courses) for all categories of staff (e.g., teachers, aides, 
administrators)? 

a. Budget % 

b. Administrative time ' % 



30. (In-Ser. Ed,, 3A) For each staff category that follows, whdii shoufd be ihe proportion of the total in that category 
who attend an in-service workshop, university course, or regional conference in the course of a year? 



Proportion of 

Staff Category Staff in Category 

a. Teachers and Counselors % 

b. Aides % 

c. Supervisors and Administrators % 

d. Support Staff % 

e. Others (specify: ) % 

Sr (In-Ser.'Ed., 5A) In-service education can take several forms. Indicate the degree of emphasis yf^W\ch should be 
given each form suggested below: 

No Great 
Emphasis Emphasis 

a. Novice-mastcr assignments 12 3 ^ 5 6 7 

b. . Participation in curriculum development 1 2 3 4 5 6 7 

c. Coaching by supervisors or others \ 2 3 4 5 6 7 

d. Workshops and conferences conducted by , - 
other ABE programs 1 2 3 4 5 6 7 

e. Workshops and conferences conducted by 
others (stale or regional agencies or in- 
stitutions 1 2 3 4 5 6 7 

f. Participation in university courses ..... 1 2 3 4 5 6 7 

g. Other (specify: ) 1 2 3 4 5 6 7 

32. (In-Ser. Ed., 7) On the average, what number of days s/jow/a^ persons in each staff category be devoting to 
. participation in in-service education in their first year with the ABE program and in subsequent years? (If none, 
so indicate.) 

First Year Subsequent Years 

a. Teachers and Counselors days days 

b. Aides . . : . . . days days 

c. Supervisors and Administrators days days 

d. Other (specify: . 

_) ■ days days 
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33. (In-Scr. Ed., 23) What is your expectation about the ways in which your staff members (especially teachers and 
aides) will become more competent as a result of in-service education? 



34. (In-Ser. Ed., 24A) To what extent should each of the following be a major outcome of in-service education? 



Little 



Great 



a. 




1 2 


3 


•1 


5 


6 


7 


b. 




1 2 


3 




5 


6 


7 


c. 




1 2 


3 


4 


5 


6 


7 


d. 


Grciiier receptivity to future in-service education 


1 2 


3 


4 


5 


6 


7 


c. 




1 2 


3 


A 


5 


6 





In-Servic5 



cation: Current Practice 



Each item in this section seeks information that accurately describes your a/rrf/?/ program. Report precise data where 
it is available. Otherwise provide yoLir best estimate. If the format of any item makes it difficult for you to" clearly, 
describe your program, respond in your own words.. 

^. - . - 

35. (hvSer. Ed., 3B) Approximately what- proportion of your staff has participated in a program of in-service 
. education conducted by your ABE program or conducted by others (e.g., university courses, slate or regional 
institutes) (a) within the past year; (b) within the past three years? (If none, so indicate.)' 



Staff Category 

a. Icachers and Counselors 

b. Aides 4 

c. Supervisors and adniinisthTtors 

d. Others (specify: '. 

- ), 



Conducted by 
Your. ABE Program 



Year 



rec Years 



% 



Conducted by Others 
a) Past b) Past 



Year 



Three Years 



70 
% 



% 
% 
% 



36. (In-Ser. Ed., IB) Approximately how many dollars were spent on in-service education of your ABE staff in the last 
j school yei\| ? ' . „ 



3.7. (In-Sen Ed., 24B) To what extent is each of the following a major outcome of curreni irs-sei vice education 
I activities? 



Littfe or No Extent 



.a. Higher staff morale • • • • 

b. Greater insight into students 

c. Increased professional competence . . . 

d. Greater receptivity to future in-service 
education 

e. Increased competence of trainers 



Great Extent 



38. (In-Ser. Eel.. 25) Wh.u suj-sesiions do you have about svays to injgrovo in-scrvicc education Jor the staff of your 



program? 
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Instruction: Intended Practices 



Each item in this section seeks information about your intents, what you are trying to do whether you are successful or ' 
not. Terms such diS should are used in the items for brevity and clarity, but they refer to '-our serious aspirations and 
intentions, and not some ideal that you do not expect to attain. 

39. (Instr., 13A) In every program, someone has the primary responsibility for orienting new students. In your 
program, who should have this responsibility (e^g., director, teacher, lab instructor, counselor, aide,*other)? 



40. (Instr. 17A) Regarding the evaluation of student (progress, h6w^/70i//cy student progress be evaluated (e.g., 
classroom tests, standardized achievernent tests, teacher summary evaluation, staff conference, combination of 
above)? I 

41. (Instr., 18A) Wliat records of student progress in the ABE program 5/70i//c^ be kept (e.g., classroom test scores, 
teacher summary evaluations, standardized achievemeot test scores)? 



42. (Instr. 23A) Most teachers emphasize certain subjects more than others. If you were free to decidef how much 
emphasis do you feel should be given to each*-of the following: 



ABE Sublects 



J. Arithmetic 

b. Reading, language skills 

c. Health education 

d. Consumer education 

e. Social studies, civics 

1. Ethnic or r^gial heritage . . . 

g. Coping (how to apply for;a iob, obtain 
legal assistance, deal with landlords) . . . 



Little or No Emphasis 



h. Other (specify:^ 



5 
5 
'5 
5 
-5 
5 



4 5 
4 5 



Great Emphasis 

7 
7 
7 
7 
7 
7 

7 
7 



'43. (Instr. 26A) How much emphasis do youteel should be placed on each of the methods of instruction listed bclow/^ 
in order to accommodate difterences among the student,<i^ 



Methods of Instruction 



□entj^? 
Littl^or N 



a. Personally tuto^ individual students. . . . 

b. Group students with similar problems or 
interests together 

'"c. - Send student to learning lab 

d. Make individual reading, writing or math/^ 
assignments .* 

e. U'?« programmed materials 

f. Other (specify: "^^ ' 

) 



q^r No Emphasis 
3 



2 

2 
2 



3 

, 3 



3 

3 , 



4f 

4 

^4 
4 



Great Emphasis 
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44. (Instr. 32A) i low iniporiMni should helping siudcnis with personal and vocational problems be in the teacher role? 

Not Important Very Important 

I 2 3 ^1 5 6 7 

45. (Instr. 37A) What part, if any, should a learning lab play in your instructional program? (A learning lab is a 
separate instructional facility utilizing progratnmed materials and in some cases instructional equipment designed 
to enable students to work individually at their own pace.) 



46. (Instr., 59A) There arc many possible goals that an ABE program might help adult students to achieve. Rank the 
goals bolow in terms of their importance to you' by writing the number / in the space next to the most important 
goal, number 2 next to the second most itnportant goal, and so on for all six goals. 

ABE Goals ^ Rank 

a. IncrLMSL'd seir-confidence of studLMils 

b. Completion or Slli grade- equivalency ' 

c. Increased" competency in language skills 

d. Preparation for high school equivalency exam. : 

e. Increased ability to cope with adult life roles and problems 

r. Prepare students to meet special short term goals (e.g., complete [ob 

application) 

g. Other ( specify: , ) 

47. (Instr. 63A) Approximately how much gain in grade level do you expect for typical students at the beginning, 
intermediate, and advanced Icveli; for every 100 hours of instruction (e.g., 1/2 grade level in reading, 1/4 grade level 
in math)? 

a. Beginning 

b. Intermediate 

c. Advanced 



<7 
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' Instruction: Current Practice 



liach item in this section seeks inrormatiun that accurately descrihes you current program. Report precise data where it 
is available. Otherwise provide your best estimate. If the format of any item makes it difTiculi tor you to clearly 
describe your piogram, respond in your own words. 

-18. (Instr., 136) In every program, someone has primary responsibility for orieniing new students to the program, hi 
your program, who now has this responsibility (check one)? 

Staff Member 



■a. Director 

b. Teacher 

c. Lab Instructor 

d. Counselor 

e. Aide. 

r. Other (specify: , 



49. (Instr., I7B) Regarding the evakiation of student progress, how is student pt ogress current /y evaluated (check 
one)? 

Evaluation Method 

a. Standardized Achievement "f est 

b. Teacher Summary Evaluation 

c. Classroom Tests 

. »t 

d. Staff Conference 

e. Combrnatfon of Above 

f. Other (specify: ._ ) 



50. (Instr., 23B) Most teachers emphasize some subjects more'^-ihinn others. In your own ABE teaching^ how much 
emphasis do you actually give to each of ihc following subjects: 

ABE Suhjecis Little or No Emphasis Great Emphasis 

A. At ithmeiic ...1 2 3 4 5 6 7 

b. Reading, language skills ... 1 2 3.4 5 6 7 

c. Health cdc/calfon 12 3 4 5 6 7 

d. Consumer education .1 2 3 4 5:6 7 

e. Social studies, civics ..... I 2 3 4 5 6 / 

r. llthfiic or racial heritage .. . I 2 3 4 5 6 7 

Coping (how to apply for a 
job, obtain legal assistance, 

deal with landlords) 1 2 3 4 5 6 7 

h. Other (specify: 

) 1 2 3 .4 5 6 7 
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51. (Instr., 21 B and 22) If siaiKlaidued achicvcmcni lesis arc admlnisicrcd ai regular intervals in your program, please 
provide ihc following informaiion: 

5ia. Inicrvals between losi a. 100 hours ol" InslrLiciion 

adminisiraiion (check one) b. 150 hours orinslruciion 

c. 200 hours ol* insirucLion 

d. Other (specify: 

) 

51b. Name of lest(s): ' 



(Note: If results of these achievement tests have been analyzed for your use, please attach copy.) 

52. (Instr., 26B) If instruction is adapted to differences among students, indicate on the scales below how much 
emphasis hcurrenily placed on each of the following to accommodate these tlifferences. 

Methods of Instruction Lirtlc or No Emphasis Great Emphasis 

ii. Personalty tutor individu;il students 12 3 4 5 6 7 

b. Group students with similar problems 

or interests together 1 2 3 A 5 6 7 

c. Send student to learning lab ...... I 2 3 A 5 6 7 

d. Make individual reading, writing, or 

math assignments 1 2 3 4 5 6 7 

e. Use programmed materials I 2 3 .4 5 6 7 

f. Other (specify: 

) 12 3 4 5 6 7 

53. (Instr. 32B) How important to the teacher role is helping students with personal and vocational problems? 

Not Important Very Import ant 

I 2 3 4 5 6 7 

54. (Instr., 37B) What pan does the learning lab play in the instructional program (e.g., u.sed only for remedial work 
for students referred by class teacher, a regular part of the students' total program, available to students who want 

it)? 
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55. (Instr., 59B) Ihcro .no many possible goals thai an ABE program might help ihc pariicipanis lo achieve. Rank 
each of these goal> in terms ol" the degree of emphasis actuallv'placed on each by writing the number / in the space 
next to the goal given the most emphasis, number 2 next to the goal given the second most emphasis, and so on for 
all six goals. 



ABE Goals Rank 



a. Incrcxr;cd selt-contidonco of siudcnis i. 

b. Completion of 8ih grade oquivalcncy 

c. Increased conipcicncy in l.uijiuaiic skills. 

d. Preparation for high school cquiv.ilency exam ; ^ 

e. Increased ability to cope with adult life roles .md problems 

f. Prepare students to nieet special short term goals (e.g., com- 
plete iob application) 

g. Other (specify: ) 

56. (Instr. 638) Approximately how much gain in grade level actually occurs lor typical students at the beginning, 
intermediate, and advanced levels for every 100 hours of instruction (e.g., 1/2 grade level in reading, 1/4 grade level 

in math)? * 

Beginning . . 

Intermediate 



Advanced 



57. (Instr., 65) How satisfied are you with the extent to which your instructional program enables students to: 

Not Satisfied Very Satisfied 

Get a job ' - ^ > ^ ^ 

Go into a job training 

program 1 2 3 5 * 6 7 

Go on to further education I J 3 -1 5 6 7 
Achieve personal goals .. . 1. .-2 3 4 5 6 7 
Achieve educationally ,..1234567 

5S. (Instr., 66) What suggestions do you have about ways to improve instruction in your ABE program? 
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Collaboration: Intended Practice 



Each item in this section seeks information about your intents, what you arc trying to do whether you are successful or 
not. Terms such dis should are used in the items*for brevity and clarity, but they refer to your serious aspirations and 
intentions, and not some Ideal that you do not expect to attain. 

59, (Col,, lA) What proportion ot your ABE budget and ol your administrative time should be allocated for 
collaboration? 

a. Budget % 

b. Administrative time % 

60. (CoL, 2) What types of organizations would you most h'ke to work with as co-sponsors and'sources of referral and 
support? 



6K (Col., 3) Describe the types of working relationships with collaborative organizations that you would to have. 



62. (Col., lOA) Listed below are seven benefits that ABE programs sometimes gain from co-sponsorship of classes and 
collaboration with agencies that refer students. Rank the importance of those benefits you ^re trying to attain for 
your program by writing the number / in the space next to the benefit you are most trying to attain, number 2 next 
to the benefit you are second most trying to attain, and so on for all benefits you are trying to attain. 

Benefits of Collaboration Rank in Order of.lmportance 

a. Rocruitment of students through co-sponsortid classes 

b. Provision of support services by collaborating organization ■ 
(e.g., child care, counseling, transportation) 

c. Extension of ABE to hard-to-reach segments of the target 

population through co-sponsored classes , 

d. Increased public awarenessjof program through co-sponsors 

and collaboration with referral agencies •. _____ 

e. Obtaining additional operating funds through co-sponsorship 

arrangemenls \ 

f. Provision of feedback about program through interaction 

with collaborating organizations ' 

g. Increased community support for ABE through collaboration 

V jwith other organizations 



64 
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CollaborationiCurrent Practice 

Each item In this scciion socks inloi maiion thai accuraicly describe, s your current program. Report precise data where 
ii is available. Otherwise pr(wide your btsl eslimate. 11 the format ol any item makes it difficult for you to clearly des- 
cribe your program, respond in your owm wards. 

63. (Col.. IB) (Approximately what pr<3jp()rtion of your A131I budge? and of your admlnlsirativc time h currently alloc- 
ated lor collaboration with outside otrgani/a lions? 

a. Budget % 

b. Administrative lime % 



64. (Col., 4) During the past year, have you cn^ployed slaM MK^mbei s whose primary responsibility is lo act as a liaison 
between the ABl£ program and the community? 



Yes . No 

//'ye.v, how many (full-time equivalent)? f.t.e. 

()5. (Col., 5) If yes, listed below are several functions commonly perlormed by liaison personnel. Rank the importance of 
of these liaison functions for your own program by writing the number / in the space next to the most important 
function, number 2 next to the second most important function, and so on for all functions listed. Add any other 
functions performed by liaison personnel in your program. 

Liaison Functions Rank in Order of Importance 

a. Recruitinj; students 

t>. l-ollovwinu up dropouts 

c. t*roviding feedback on the success of the 

ABt proi^Mni in the community 

d. Establishing co-sponsorship 

c. Other (specify: _ ) 



66. (Col., 8) During the past year, to what extent has your program experienced difficulty in establishing contact with 
potential co-sponsors and agencies that refer students? 



Little or No Extent Great Extent 



12 3 4 5 6 7 

67. (Col., lOB) Listed below are some benefits that ABE programs may gain from co-sppnsorship of classes and 
collaboration with agencies that refer students. Rank the importance of the benefits that your program actually 
receives by wrtting'the number I in the space next to the most important benefit, number^ 2 next to the second 
most important benefit, and so on for all benefits received. 

Benefits of Collaboration Rank in Order of Importance 

a. Recruitment of students ihroujih co-sponsored classes 

b. Provision of support services by collaborating organi- 
zations (e.g., child care, counseling, iransporiailon) 

c. Extension of ABE to hard-to-reach segments of the 
target population through co-sponsored classes 

d. Increased public awareness of program through co- 
sponsorship and collaboration with referral agencies 

e. " Obtaining additional operating funds through co- 

sponsorship arrangements / '* 

f. Provision of feedback about your program through 

interaction with collaborating organisations 

g. Increased community support for ABE through col- 
laboration with other organizations 

65 
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68, (Col., I2B) Lisivtl lu'low arc l ive distidvaniagcs somciimcs incLti rcd by Alii: programs as a result of co-sponsorship 
of classes and collaboraliun wilh agencies lhal refer siudcn'.s. Rank I he magniiLtde of the disadvaniages thai your 
program actually incurs by writing the number / in the space next to the greatest disadvantage, number 2 next to 
the second greatest disadvantage, and so on for all disadvantages incurred. 

Rjnk in Ordcr'of 

Disadvaniugcs of CollahoiJiion Magnitude of OisacJvjntjges 

a. l^o.ss ol progr.un I Icxihiliiy as ii rcsuli of collaboration ' 

b. Deer CM so in administrative autonomy as a result o( 

collaboriUion 

, c. Collaboration results in i;crvin« students not represen- 
tative of target population the program is trying to reach 

d. increase in unit cost (per instructional hour) as a result 
of collaboration 

e. More of your lime ihun desirable spent on arranging lor 

and administering? collaborative efforts 

69: (Col., 14) VVhiit suggestions do you have about improving collaboration wilh oiganizations that co-sponsor classes 
and refer students? 



! 
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Goai-Setting: Intended Practice 



Each item in this section seeks information about your intents, what you are trying to do whether you are successful or 
not. Terms such as should are used in the items for brevity and clarity, but they refer to your serious aspirations and 
intentions, and not some idea! that you do not expect to attain. 

70. (Goal, 1 A) What persons and groups should have the most influence on setting local ABE program goals and 
priorities? 



71. (Goal, 2A) What rok should each person or group typically play in the goal-setting process? 



72. (Goal, 6A) What should your ABE unit have by way of a written statement of goals. 



Goal-Setting: Current Practice 



Each item in this section seeks int'ormaiion ihai accurately describes your cunrent program. Report precise data whcr;c 
it is available. Otherwise provide your best estimate. If the format of any Item makes it dilficult for you to clearly 
describe your program, respond in your own words. 

73. (Goal, IB) What persons or groups currently have the most influence on setting local ABE program goals? 



74. (Goal, 2B) What role does each person or group typically play in the current j^oal-sctting process? 



75. (Goal, 6B) What does your ABE unit currently have by the way of a written statement of goals? 



76. (Goal, 7) Which of the following policy decisions related to program goals and priorities have actually been made 
or modified during the past year or so in your local ABE program? (Check all that apply.) 

Definition of target population . 

Selection of student recruitment strategy 

. Formulation of criteria for staff selection 

' Determination of relative emphasis on various 

instructional areas 

■ ^Determination of strategics for obtaining com> 

munity support 

Decision on degree of centralization vs. decen> 

tralization of class locations ' * 
* ■ Policy related to collaboration with community 

g^'OLips and organizations • 

J Other (specify: \ ) 



77. (Goal, 8) What suggestions do you have about/ways to improye the process of setting goals and priorities in your 
ABE program? 
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Other Components 



78. The foregoing iterns have been grouped within six program components (recruitment, staffing, in-service educa- 
tion, instruction, collaboration, and goaUctting). There are, of course, additional program compo/icnis that have 
not been covered (e.g., facilities, program administration, finances, materials selection and development). What 
other aspects of your ABt; program seem to be most in need of intensive evaluation? 

Intended Practice 

Each item m this section seeks information about your intents, v^hat you are trying to do whether you are successful or 
not. Terms such Ti^ should are used in the items for brevity and clarity, but ihey refer to your serious aspirations and 
intentions, and^not some ideal that you do not expect to attain. 

79. (Instr., 11 A) Of the instructional materials used in the ABE clas^, what proportion s/70i//c^ be? 



a. commercially published 

b. prepared or adapted by yourself 

c. prepared or adapted locally . . . . 



Total ^ 100% 



80.^ (Instr., 12A) What should be the proportional distribution of ABE classroom facilities between the following types 
of locations? - J * 

a. Adult education center used for 

'clustered classes day and evening .... % 

b. Scattered classes in school buildings, 

after school % 



c. Scattered outreach classes in facilities 
of co-sponsors 

e. Other (specify: 



) % 

Total = ■ 100% 

8L In what other parts of the ABE orogram would you like to see major changes? What would the changes be? 
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Current Practice 



Each item in this section seeks inrormation thai accurately describes youi' current program. Report precise data where 
li is available. Otherwise provide your best estimate. If the format of any item makes it difficult for you to clearly des- 
cribe your pfui:ram, respond in your own words. 

82. (Insir., 11 B) Of the insiruciionni materials you currently use in your class what proportion are: 

a. Coriitncrcially published 

b. Prepared or adapted by teacher 

c. Prcpiircd or a da pled locally . . . 

83. (Instr., 128) What is the current proportional distribution of AfBE classroom facilities between the following 
I y pes of locations.? 

a. Adult education cetiier used lur 

clusiered classes day and evening 

1>. Seaitcrcd classes in school buildings, 
.1 ■ ^ after school '. 

■ c. Scattered ouircach classes in facilities ol' 
' ' co-sponsors ; . . . 

d. Other (spec{(y: 

. ). 

■ Total. = 100% 

84. In additon to the foregoing information about the ABE program, what else should someone know about the 
current program in order to understand basically how well it functions? 



% 

% 

Total 100% 



% 
% 

% 
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Administrative Staff Interview Guide 



Instructions to Interviewer ■ 

Each question in -this Guide is meani lo clicii a slatcmoni of INTENDED pracllcc. The inlerviewer musi emphasize this 
in the beginning and throughout the interview. He should be alert to a natural tendency on the pari of the inierviewee 
lo answer as though he was being asked to describe current practice — the way he believes the program is operating at the 
present lime. This distinction between how he feels the program should function, given his present constraints and 
situation, and the nature of current practice is central to this kind of evaluation and requires continual reinforcement 
by the interviewer. 

The purpose of the items on intended practice is to assist the respondent to describe what he is striving lo 
accomplish within his present context and not to describe an unattainable ideal. The term should refers to serious^ 
aspirations and intentions. 

The interviewer should read each question in its entirety,, including all the illustrations given in parenthesis. This will 
encourage specificity in response and enhance comparability in later analysis. Only rankings should involve a written 
response by the interviewee. 

Read this stalemenl to the interviewee prior lo beginning the interview: 

FOR THE PURPOSES OF THIS INTERVIEW. ASSUME THAT YOU HAVE BEEN PROMOTED IN THE 
I SCHOOL SYSTEM. ALTHOUGH ABE REMAINS ONE OF SEVERAL PROGRAMS OVER WHICH YOU HAVE 
RESPONSIBILITY, THE DIRECTION OF THE PROGRAM WILL BE GIVEN TO YOUR SUCCESSOR. 
RESPOND TO EACH QUESTION AS THOUGH YOU WERE ADVISING HIM ON HOW THE PROGRAM 
SHOULD FUNCTION. DO NOT SIMPLY DESCRIBE HOW IT IS PRESENTLY. FUNCTIONING. TELL HIM . 
WHAT SHOULD HAPPEN IN THE PROGRAM IF EVERYTHING GOES THE WAY YOU MEAN IT TO GO. 
DESCRIBE YOUR INTENTIONS. . * 

Part 1: Recruitment * - 

• The items in this part deal with the process by which potential students hear about and are recruited lo your ABE 
program. 

I. (Rec, 1) What kinds of staff (e.g., teachers, aides, counselors,) s^ow/c^ be' involved in recruitment activities? 



.. 2. (Rec, 2A) About how many hours per week should typical staff members in each category mentioned above 
spend on recruitment? ■ 



3. (Rec, 3A) What proportion of your ABE budget and of your administrative time should be allocated for 
recruitment of students? 

» a. Budget •• % 

b. Administrative time _ % . ' 
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4. (Rec, 4) There arc many methods that can be used to recruit students (e.g., mass media advertising, door-to-door 
canvassing, referral from other agencies, v^ord of mouth). What methods s/70t//(y be- emphasized in the recruitment , 
"o!" students tor your program? 



5. (Rec, 5A) Which recruitment methods mentioned above a ho uld be used to reach particular target groups (e.g., 
young males, non-linglish speaking, least literate, Blacks)? 



6. (Rcc, 6A) What arc the main messages, that you -intend to convey to prospccllvc students through your 
recruitment ei'fori? 



7. (Rec, 7) What are the characteristics of the target population you arc try/ng to reach (age, sex, ethnic background, 
place oi residence)? 

• (3 



8. (Rec.,8A) Are there particular groups that you espcciaffy try to reach (e.g., young males, older'adulis, Blacks, 
non-English spca.king, least literate)? If yes, which are the high priority groups? 



9. (Rec, 9) G/Vt?/7 your present resources^ what would you iilie your total current enrollment to be (active students 
at any one lime) ? ■ 

. ■ ■■ • ■ students 



10.. (Rec, ISA) What is youi goa/ regarding the approximate proportion of students who. are enrolled at the first week 
* in J he fall and who are still active as of the sixth week of class? 



1 1. (Rec, 16) What, suggestions do you have about ways to improve the recruitment process in your ABE program? 

X 
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Part 2: Staffing 



^Thc items in this part deal with the process by which potential sta^'-* members are attracted, selected, and placed in^your 
ABE program. ' 

. 12. (Staff., 3) Aside from personality and criteria mandated by stale or local regulations, what criteria stot/Zof govern 
the selection of ABE teachers (e.g., experience teaching adults, elementary education experience, age, ethnicity, 
pre-service education)? 



13. (Staff., 4) What critcria*'5/7ot//£y govern the selection of instructional aides? 



,14. (Staff., lA) What proportion, of your ABE budget and of your adminsitrative \.\v[\q should be allocated for staffing 
(c*.g.7^ setting selection criteria, identifying sources of staff, recruifmg staff, selecting and hiring staff, and 
assignment of new staff)? ' . i 

a. Budget %^ 

- b. Administrative time % • ^ — 



1 5. '(Staff., 2A) \Slho should have the most to say in determining the criteria used in hiring teachers? 



16. (Staff., 7) Should uny effort be made to recruit ABE teachers from outside the public school system? 

^ ^ ^. ■ ■ ■ . . 

Yes No 



17. (Staff.;* S) //"y^i* from what sources? 



18. (Staff., M^) Who should be. lively involved in the process of selecting and hiring teachers for your program? 
' What should their roles be? 
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ly. (Staff.,' 1 1 A) 'U'luu \\n:{oi-s s/u)(//c/ he t.iluMi into accoinit in assii^ninj; (cachet's to a pariicular class (e.g., previous 
c \ per ic nee , se \ , c i li n i ci I y ) ^ 




/ 

20. (Staff., 12) Ihis quetiion concerns vvhai you would like the composilion ot your insiruciiona) sialf \o he in 
lerms of nge, se.x.^oihnicity, and u\ilivn\i,. 11" you would like lo have ai /eas( a certain proportion of your teachers in 
a given category, e.g., "under 3.^'* or "special education background," please indicate ihis mimmum proportion. If 
you would like to have/?c; more than w certain proportion of your tcdchers in a given c^uegury, please indicate that 
n^a.xinium. If you have no preference, i.e., if i( would make no difference W all or none of yoLff teachers were In 
this category, please indicate this. Repeat the process for instructional aides. 



Age 



Under 35 
50 or more 



Teachers 



Aides 



Minirnurn^ Maximum No. 
Percent Percent Pref. 



% 
% 



7o 



Minimuni Maximum No. 
Percent Percent Pref. 



% 
% 
% 



Sex 



Male 
Female 



% 
% 



% 
% 



% 



Ethnicity 
Black 
VVhile 

Hispano-Amcrican 
Other (specify: 



% 
% 
% 



, % 
. % 

,% 

. % ■ 



_ % 
_ % 



% 
% 



Training 

Elementary 
Education (K-6) 

Secondary. 
Education (7-12) 

Other Education \. 
Training, specify: ^? 



b: 



% 
% 



% 
% 



% 



% 
% 



No prior preparation 
*ln education 
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Part 3: In-Service Education 



The items in this part ideal with the ways in which your ABl: staff members increase their competence through various 
•in-service education aetivitie;;. 

22. (In-Ser. Ed., 2A) What proportion of your ABIZ hudge.t and of your administrative time should be allocated for. 
in-service education (e.g., workshops, conferences, courses) for all categories of staff (e.g., teachers, aides, 
administrators)? 

^ • a. Budget % 

b. Administrative time % 

23. (In-Ser. Ed., 3A) For <\.ch staff category thai. follows, what i7?o///c/ be the proportion of tite total in that category 
who attend an in^service workshop, university course, or regional conference in the course of a year? 

Staff Category 

.J. TejclJors ijnd Coufjsclors 

■ . h. Aides 

c. Supervisors and Adminisir.iiors 

d. Other (specify: 

24. (In-Scr. Ed., 4A) Whal criteria 5/7w/c/ be used lo select participants for an in-scrvicc education program (e.g., prior 
training, supervisor selection, duration of employment, self-selection, category of position)? . 



Proportion of Staff in Category 

. % 

% 

% 

% 



25. (In-Ser. Ed., 5A) In-service education can take several forms. Indicate the degree of emphasis which s/7o^//c/ be 
given each form suggested below: 



No Emphasis 



a. Novicc-ma*".er assignments 

b. l^ariicipiiilon in curricuiuni development . . 

c. Coacliinj; by supervisors or oUiers 

d. Workshops and conterences conducted by 

your ABl: program '. . 

e. Workshops anil conic re nee s conducted by 

others (stale or rej;ional agencies or 
insiitu lions) 

{. P.iriicipation in university courses 

g. Oilier (specify: ) 



! 



Great Emphasis 



26. (In-Ser. Ed., 6A) What categories siixH should perform the main roles in planning and conducting in-service 
education (e.g., setting objeclivcs, appraisal of needs, selecting and organizing learning activities, evaluation)? What . 
should eiich of Uicir roles typically be? 
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27, (In-Scr., Ed.. 7) On iho avoracic. wlui number ot days shoufd persons in each siatT category be devoting to partici- 
pation in in-service education in their first year with the ABE program and in subsequent years? (If none, so indicate). 

• ' 

First Year Suh^quent Years 

^ .1. To.Klu r .ind ».oun>olor> days ^"JY^ 

b. AiJes ^ days days 

w. Supei\ isois .md adminisiiaiors . . . days tlays 

) days days 

28. (livSer., Ed., SA) What incenti\e> >7?o;//d used to encourage participation in an in-service education program 
(e.g., released leaching time, extra pay. required attendance)? 



29. (In-Scr. Ed., 23) What is your tWfycaaiton about the wa\s in which your staff members (especially teachers and 
aides) will become n>ore compotcni as a result of in-service education? 



30. (In-Scr. Ed., 24A) To what extent .s/ww/cf each of tlie following be a major outcome of in-service education? 

Little Great 

' • a. Higher ssaif morale ) 2 3 4 5 6 7 

h. Greaier ^n^ii^hl inio siudonis I 2 3 A 5 6 7 

IncreasoJ protessional con^pcience \ 2 3 A S 6 7 
- " ■ . . - "^ 
<i. Greaicr reccpiiviiy lo fuiujc in-ser- 
vice ediicjiion 3 2 3 A 5 6 7 

0. IncreaNcd compeiencc o< irainers 1 .2 3 •? 5 6 7 

31. (In-Ser. Ed., 25) What suggest ions do you luvc about wa\'S lo improve in-service education for the staff of your 
program.^ 



Part 4: Instruction 



The items in this pan deal wiih ihc process of learning and insf uciion in your AB(I program. 

32. (Jnstr., 12A) What should be ihe propo/ iional disiribuiion o( AlilZ classroom faalltles bciwccn ihc loi'DWing types 
of locations? 

a. Adult education center usod for clustered classes 

, day ."ind evening % 

b. Scattered classes in school buildings, after school % 

c. Scattered outreach classes in facilities of co-sponsors % 

d. Other {s(7ecify: 

) % 

Total = 100% 1^, 

3.^, (instr., 13A) In every program, someone has the primary rcsponsibiliiy for orienting new students. In your 
program, who should have this responsibility (e.g., director, teacher, lab instructor, counselor, aide, other)? 




34. (Instr., 14A) Often, ABE programs make an initial assessment of student's achievement level. How should siudcni 
enirance level be assessed (e.g., standardized test, locally developed test, interview, combination of above, none)? 



35.' (Instr., ISA) Who should make the initial assessment of student skill levels (e.g., director, teacher, lab instructor, 
aide, counselor, no one)? . • 



36. (Insir., 16A) Regarding the adminisiraiion of diagnostic placement tests, w/?^/? 5/70/7/6^ these tests be administered 
(e.g., never, at tin^ie of enrollment, after enrollment when student is ready)? 



37. (Instr., 17A) Regarding the evaluation of student progress, how should student progress be evali/ated (e.g., 
classroom tests, standardized achievement tests, teacher summary evaluation, staff conference,. combination of 
above)? i 



^wi.-^^ 38, (Insir., [8A) What records ol student progress in the ABE program should be kepi (e.g., classroom test scores, 
teacher summary evaluation, standardized achievement test scores)? - 



39. (Instr., 19A) 'l o what uses should student records (from regular classes, learning lab, other sources) be put (e.g., to 
measure student progress, place students in. classes, counsel students, refer students lo other educational programs 
or employers)? 



40. (Instr., 20A) If standardized achievement tests are used, should they be administered ai regular intervals? 
Z ^ Ycs ' No = 



4 I . (Instr., 21 A) If yes, at what intervals iV/ow/c^ they be administered? 



42. (Instr., 37A) What part, if any, s/70t//o^ a learning lab play in your instructional program?(A learning lab is a 
separate instructional faciliiy utilizing programmed materials and in some cases instructional equipment designed 
to enable siudenls to work individually at their own pace.) 



43. (Instr., 38A) Ho^ should the student's work in the (ab be coordinated with classroom instruction? 



44. (Instr., 39A) What categories of staff should be associated with the learning lab and what should their duties be? 



(The next three questions deal wilh the individual student's schedule of activities in the learning lab.) 
45. (Instr., 40A) How frequently 5/70f//c/ the student have contact v^ith each category of staff member? 



46. (Instr., 41A) How should these contacts be initiated (e.g., staff circulating in the lab, staff stationed at desks 
available to students when students want help)? 



! 
r 
( 
» 

I- 

t 

t 

47. (Instr., 42A) What 'sorts of help s/70£//t/ the staff give students? 

I 



48. (Instr., 43A) How 5/70t//d/ student progress in the learning lab be recorded?* 'What kind of information s/70t//t/ be 
kept? By whom? Available to whom? In effect, what should the student information system be like?^. 



: i 

1,- 

49. (Instr., 63A) Approximately how much gain in grade level do you expect for typical students at the beginning, 
intcrnicdiatc, and advanced levels for every 100 hours of instruction (e.g., 1/2 grade level in reading, 1/4 grade level 
in math)? ^ 

a. Beginning 

b. Intermediate 

c. Advanced 



50. (Instr., 66) What suggestions do you have about ways to improve instruction in your ABE program? 



Part 5: Collaboration 



The items in this pari deal with relationships between your ABE programs and community groups' with which you 
collaborate, such as co-sponsors and referral agencies. 

51. (Cel., 1A) What proportion of your ABE budget and of your administrative- time should be allocated for 
collaboration? 

a. Budget % 

b. Administrative time % 

52. (Cel., 2) What types of organizations would you most like to work with as co-sponsors and sources of referral and 
support? 



53. (Cel., 3) Describe the types of working relationships with collaborative organizations that you would like to have. 



54. (Cel., lOA) Listed below are seven benefits that ABE programs sometimes gain from co-sponsorship of classes and 
collaboration with agencies that refer students. Rank the importance of those benefits you are trying to attain for 
your program by writing the number / in the space next to the benefit you are most trying to attain, and so on for 
all benefits you are trying to attain. 

Rank in Order 

Benefits of Collaboration of Importance 

a a. Recrult\ncnt of students through co- 
sponsored classes 

b. Provision of support services by colla- 
borating organizations {e.g., child care, 
counseling, transportation). . . . ' 

c. Extensions of ABt to hard-to reach 
segments of the target population 

through co-sponsored classes. . 



d. Increased public awareness of program 
through co-sponsorship and collaboration 

with referral agencies \ 

c. Obtaining additional operating funds 

through co-sponsorship arrangements . . . 

f. Provision of feedback about program 
through interaction with collaborating 

organizations 

g. Increased community support for ABE \ 
through collaboration with other or- 
ganizations .* 

\ - ' ■ i 
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55. (Col., 11) Are there .inv other benefits that you expect your program to attain from collaboration that arc not 
listed above? Is so, briefly list. 



•56. (Col., 12A) Listed below arc five disadvantages sometimes associated v^ith co-sponsorship of civisscs and 
collaboration with agencies that refer students. Which of the following disadvantages are most important to avoid? 
Write the nuhibcr / in the space next to the disadvantage that you most want to avoid, number 2 next to the 
disadvantage you second most want lo avoid, and so on for all five disadvantage. 

Disadvantages of Collaboration Rank Order of Disadvantages 

a. Loss of program flexibility as a result of collaboration 

b. Decrease in administrative autonomy as a result of 

collaboration » 

c. Collaboration results in serving students not represen- 
tative of target population program is trying to reach :_ 

d. Increase in unit cost (instructional hour) as a result 

of coUaboration * - . 

c. More of your time than is desirable spent on arranging ' ■ 

for and administering collaborative efforts 

57. (Col., 13) Are there any other disadvantages that you try to avoid related lo cb-sponsorship or collaboration with 
agencies that refer students? If so, briefly list. 



58. (Col., 14) What suggestions do you have about improving collaboration with organization that co-sponsor classes ' 
and refer students? - 
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' . ' Part 6: Goal-Setting . 

The items in this part deal with the^process by which goals are set for your ABE pfogram^^ . ' . ■ . ,. ■ ■ " ' 

. 59. (Goal,. lA) What -persons and groups stoi//^/ have -the most influence on .setting local >i '8 E program goals and 
- priorities? * . . ..• . , * ' . . ^ 



60. (Goal, 2A) What ro\Q should oach person or group typically play in the goal-setting process? 



61, (Goal, 3A) Hov^ should the working relationship between the ABE unit and collaborative organizations influence 
the goal-setting process (e.g., having a say in course purposes, staff characteristics)? 



62. (GoaI,;4A) There. are a number of factors that can influence goal-setting and program priorities. Indicate to what 
extent each factor listed below should influence the goals and priorities of your local ABE program. 



■A 



..Desirable Extent of Influence on Goals and Priorities 



factors \ Little or'None Great 

: \' : — - • 

State ABE plan 1 2 3 4 5 6 7 

General population characteristics 1 2 3 4 .5 6 7 

Other ABE programs in the community ........ 1 2 3 4 5 6 7 

Expectations of the students 1 2 3 4 5 6 7 

Relations with school system . 1 . . I \ 2 2 3 4 5 6 7 

GEO exam 1 2.3 4 5 6 7 

Expectations of the community . ........... 1 2 3 4 5 6 7 

63. (Goal, 6A) What s/70w/c/ your ABE unit have by way of a written statement of goals? 



64. (Goal, 8) What suggestions do you have about ways to improve the process of setting goals and priorities in your 
ABE program? 



Lab Supervisor Interview Guide 



. 1. (Instr., What pari dqes the- learning lab play in ihc insuuciional program (e.g., used only for remedial Work 
for siudenls referred' by class teacher, a regular pari of the students' total program, available to students who want 



2. (Instr., 38B) How is the student's work in the lab coordinated with classroom instruction (e.g., not coordinated in 
nn\ ^pccif^c way, student's work prescribed by teacher, student's work prescribed by counselo/, student's work 
prescribed by lab supvervisorj conference between teacher, counselor, lab supervisor)? 



3. (Insrr., 39B) What categories of staff are currently associated with the. learning lab and what are their duties? 

i ■ ■ 

i ' • ■ ■ 

! . ■' • 

(The ne\'. three questions deal with the individual student's schedule of activities in the (earning lab) 

4. (IrvAr., 40B) How frequently does the student £/c/i/a//y have contact with each category of staff member? 



5. (In:;ir., 418) How are these contacts initiated (e.g., staff circulating in the lab, staff stationed at desks av^ilable to 
.ludenis when studeni> wani them)? 



6. (f;.str.. 42B) What sorts of help (^fees the staff give students? 



7. (InsiT., 43B) How is student progress in the learning lab currently recorded? What kind of information is kept?j$y 
v/htwri? Available to whom? In effect, what is the student information system like? ^ 
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Questionnaires 



This section provides four sclf-administcrcd questionnaires for the collection of evaluation data. The intended 
respondent for each questionnaire is designated in the title — Director Questionnaire, Teacher Questionnaire, and so on. 
In larger ABE programs it may be necessary to distribute questionnaires to only a representative si/mp/e of teachers, 
students, and co-sponsors. 

If* a questionnaire seems well-suited for use in a specific ABE program, the direr;tor simply makes copies and 
distributes them. If a questionnaire does not seem to fit, items should be added, deleted, and modified. When doing so, 
it is important to preserve the parallelism betv^een the items on current practice in the questionnaires and forms and the 
items on intended practice in the interviev^ guides. It is also important to preserve the internal flow of questionnaire 
items so that early items prepare the respondent for answering later items. 
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Director Questionnaire 
Part 1: Recruitment 



The ilctms lu this part deal with your current practices related to attraction and recruitment of ABE students. 
; j . ^ ' 

]. (Rec, 2B) |ln a typical week, about how many hours does the average staff member spct)d on recruitment? (If, in V 
any staff category, no members are involved in recruitment, write none in the hours/week column.) 



Staff Category ' 
TcacJier 

Aide (paraprofcssional) 
Counselor 
Supervisor 
ABE^Direciqr 
Other (Specify: 



Hours per week 



2. (Rec, 3B) Approximately what proportion of your ABE budget and of your administrative time is currently 
allocated for r^ecruitmeni of students? 



a. Budget 

b. Administrative time 



% 



3. (Rec, 58) Listed at the left of the matrix below are several groups tfiat are- often the focus of ABE recruitment 
efforts. Listed at the top of the matrix are a number of recruitment methods. For each group listed, indicate by a 
checkmark in the appropriate space(s) in the row to the right, the one or. two methods you currently rely on most 
for recruiting persons in that group. [ , 



Recruitment Methods 



Door 

to 
Door 



Mass 
Media 



Agency 
Referral 



Co- 
Sponsored 
Classes 



Word 

of 
Mouth 



Other: 



Young adults 
Non-English speaking 
Blacks 
Males 

Unemployed 
Least literate 

Other 

Other . 

Other 



4. (Rec, 6B) What are the main messages that seem to actually get through to prospective students in your 
recruitment efforts? ' ^ 
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5. (Rec, 8B) In recruiting ABE students, how successful have you actuaU^ been in reaching each of the following 
groups, compared with your expectations (include any additional group\^ou attempted to recruit)? 

Recruitment Success 

Little or [ Great 

Group No Success ' Success 

Young adults I 2 3 4 5 6 7 

^on-English speaking 1 2 3 4 5 6 7 

^ Blacks 1 2 3 • 4 5 6 7 

Unemployed^ 1 2 3-'4 5 6 7 

Males' i 2 3 4 5 6 7 

l^east literate 1 2 3 4 5 6 7 

Other 12 3 4 5 6 7" 

Other 12 3 4 5 6 7 

Other 1 2 3 4 5 6 7 

General Target Population 12 3 4 5 6 7 

6a. (Rec, 10) Is your ct/rreA?^ enrollment as high as budgetary resources will permit? 

Yes No 



6b. (Rec, 11) During the past year, to what extent has your program experienced difficulty in recruiting the kinds of 
students you want to reach? [ I ^ 



Little or 
No Extent 



Great 
Extent 



Part 2: Staffing 



Items 7 through 1 1 deal with your Intents and expectations regarding the attraction, selection, and placemgnl of ABE 
staff, whether or not you have been able to accomplish what you are striving for. 

7. (Staff., 13) In overall performance, some teachers and aides are clearly superior to others. Realistically speaking, 
about what proportion of your instructional staff do you expect to be: 

Proportion 



Teachers Aides 



ii. Excellent . 

b. Very good 

c. Good . . . . 

d. Fair 

c. Poor 



% 



.% 
.% 
.% 



Total = ^ 100% 100% 

8. (Staff., 14) Some teachers get along well with other teachers and staff members and others do not, How important 
is it to you Jhat each teacher get along well with each category of staff member listed below? 



a. Other Teachers. 

b. Aides ........ 

c. Counselors . . . . 

d. Supervisors . . . 
c. ABE Director . . 



Not 
Import ant 

1 
I 
I 



Importance of Getting Along WelT 

Very 
Important 



Not 
Applicable 

0 
0 
0 
0 
0 



9r (Staff., 16A) Not all teachers are equally satisfied with their work in ABE. About what proportion of your 
" /e£/c/7er5 do.you ^'Vp^c/ to be:, 



ii. Very Sat.'^ricd . . . . . 

b. Moderately Satisfied 

c. Dissatisfied .... . . . 



Proportion 

% 

% 

% 



Total = 100% 



10. (Staff., 17A) Some teachers are more personally committed to the goals of ABE than'ot^nirs. About what 
proportion of your teachers do you expec/ to be: 



Proportion 



<i. Highly Committed .... 

b. Moderately Committed 

c. Uncommiucd .'. 



Total = 100% 



1 I. (Staff., 18A) Do you expect the annual turnover of teachers in your ABE program to be (check one for each 
column): 

Teachers Aides 

Heavy (25% or more) 

Morjeraie (10-24%) 

Light (less than 10%) 

The remaining items related to STAFFING deal with your actual current practice. 

12. (Staff,, 2B) Who has the most say in determining the criteria used in hiring teachers for your program? 



13. (Staff., IB) Approximately what proportion of your ABE budget and administrative time is ct/rreA? /^/y allocated for 
staffing (e.g., setting selection criteria, identifying sources of staff, recruiting staff, selecting and hiring staff, and 
assignment of new staff)? 

a. Budget % 

b. Administrative time % 

14. (Staff., 5) To what extent are each of the following criteria important in the recruitment and selection of staff? 

Little or no Great 
Criteria Importance Importance 



a. Regular school staff 

b. Experience lea: hing adults 

c. Age 

d. Elementary education experience . 

e. Ethnicity 

' f. Place of residence ; . . 

/ 

15. (Staff., 6) How difficult is it to compete with other employers as you recruit staff, given the incentives you have 
to offer? 

Very Difficult, Poor Easy, We Ha^ i 

Competitive Position Great Advantage 



2 3 4 5 6-7 

2 3 4 5 6 7 

2 ' 3 4 5 6 7 

2 3 4 5 6 7 

2 3 4 5 6 7 

2 3 4 5 6 7 



16. (Staff., lOB) Who is actively involved in thf orocess of selecting and \\\uv[% teachers for your program (check all 
that apply)? • 

■ ' ■ \ \ 

a. \ A BE Director ^ \ \ ■ 

' i ■. 

b. ABE Teachers . i \ , 

c. School Personnel Office ! 

d. ABE Supervisors 

e. Other (specify: ^ 

• .)■ 



i ; (Staff., lOB) Whal is the role ol each in ihc staffing process? 



18. (Staff., 11B) Which of the following factors are generally taken into account in assigning teachers to a particular 
class (check all that apply)? 



a. Teacher's prior experience and/or training 

b. Ethnicity of teacher 

c. ^ Sex of teacher 

d. Age of teacher 

c. None of the above 

f. Other (specify. ■ y 
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Part 3: In-Service Education 



The items in this part deal with your current practice related to in-service education of ABE stalT members. 

19. (In-Ser. £d., 3B) Aproximately what proportion of your staff has participated in a program of in-service education 
- conducted by your ABE program or by others (e.g., university courses; state or regional institutes) within thc"past 

year and within the past three years? (If none, so indicate.) 

Conducted by 
Your ABE Program Conducted by Others 

Past Past Past Past 

Staff Category Year Three Years Year Three Years 

a. Teachers and Counselcrs % % % 

b. Aides % % % % 

c. Supervisors and Administrators % % % . % 

d: Others (specify: ) % % ' _% % 

20. (In-Ser. Ed., 4B) What criteria were used to select participants for in-service workshops, conferences or courses 
held in the past year (e.g., prior training, supervisor selection, nature of position)? 



21. (In-Ser. Ed., IB) Approximately how many dollars were spent on in-service education of your ABE staff in the last 
school year? 



22. (In-Ser. Ed., 2B) What proportion of your operating budget did the dollar amount above represent? 



23. (In-Ser. Ed., 2B) What proportion of administrative time was used last school year for in-service education? 

% 

24. (In-Ser. Ed., 1A) Approximately how many dollars would be required for you to do an acceptable job of providing 
in-service education for your staff? 

$ 



25. (In-Ser. Ed., 9) Do you make a regular practice of 

assigning new staff members to Yes 

work with experienced staff members 

who do the same kind of work? No 



26. (In-Ser. Ed., 10) If yes, what special conditions of employment are involved during this initial period (e.g., 
duratiah of assignment, full or part pay, union requirement)? 

27. (In-Ser. Ed., 11) What is the value of such an assignment for enhancing staff performance? 

Little Value Great Value 

I 2 3 4 5 6 7 
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28: (In-Ser. Ed., 12) Arc there any special problems related to this practice? 



29r(In-Ser. Cd., 13) Is this forrri of in-service education . Yes - 

much different for teachers than for . 
other categories of ABE staff? No 

30. (In-Ser. Ed., 14) If yes, please describe the distinctive v^ays in v^hich this form is used for teachers. 



31. (In-Ser. Ed., 15) Do you consider staff participation in curriculum development 7i planned component of your 
in-service education effort? 

Yes No 



32. (In-Ser. Ed., 16) If yes, what special conditions pertain (e.g., released time, extra pay, required of all)? 



33. (In-Ser. Ed., 17) On the average, what number of days 

per year are devoted by each staff 

member to this practice? Days 

34. (In-Ser. Ed., 18) Are there any special problems attendant on this practice? 



35. (In-Ser. Ed., 19) is this form of in-service education much different for teachers than for other categories of ABE 
staff? ' 

Yes No 



36. (!n-Ser. Ed., 20) If yes, please describe the distinctive ways in which this form is used for teachers. 



37. (In-Ser. Ed., 8B) What incentives are used to encourage participation in your in-service education program' (check 
all that apply)? 

Released time from regular duties 
Extra pay 

Condition of continued employment (attendance required) 
Other (specify: ) 
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38. (In-Ser. Ed., 6B) What categories of sidiW currently perform the main roles in planning and conducting in-service 
education (e.g., selling objectives, appraisal of needs, selecting and organizing learning activities; evaluation)? What 
roles do each of them typically perform? 



39. (In-Ser. Ed. 24B) To what extent is each of the follov^ing a major outcome of current in-service education 
activities? 



Little or 
No Extent 



Great 
Extent 



a. Higher sialf morale 

b. Greater insight into students . . . . . 

c. fncreascd professional competence 

d. Greater receptivity to future 
in-service education 

e. Increased competence of trainers . 



6 7 
6 7 
6 7 



93 



Part 4: Instruction 



The items in this part deal with learning and instruction in the entire ABE program. Note that items 40 through 46 deal 
with what you intend to do, and the remainder deal with what you are a/rre/7r/y doing: 
-40.- (Instr, -1-1A) Of the instructional materials used in the ABE class,~what proportion should be: .„ 

a. commercially published . % 

b. prepared or adapted by teacher . . . . % 

c. prepared or adapted locally % 

4K (Instr., 23A) Most teachers emphasize certain subjects more than others. If you were free to decide, how much 
emphasis do you feel should be given to each of the following: 

Little or Great 
ABE Subjects No Emphasis Empliasis 

a.' Arithmetic I 2 3 A 5 6 7 

h. RcidinsJanguage skills 12 3-1 5 6 7 

c. Health education : I 2 3 4 5 6 7 

d. Consumer education 1 2 3 4 5 6 7 

e. Social studies, civics I 2 3 4 5 6 7 

f. Ethnic or racial heritage 1 2 3 4 5 6 7 

Copinji (how 10 apply for a job, obtain legal 

assistance, deal with landlords) I 2 3 4 5 6 7 

h. Other (specify: ) I 2 3 4 5 6 7 

42. (Instr., 27A) There are a number of ways that students participate in their instruction. To what extent s/70ty/^/ 
students participate in each of the following ways? 

Type of Student Little Great 

Participation or None Extent 

a. Student recites" 12 3 4 5 6 7 

b. Pairs or small groups of students 

practice skills together I 2 3 A 5 6 7 

c. Small groups engage in problem 

solving....... 12 3 4 5 6 7 

d. Whole class participates in discussion i 2 3 4 5 6 7 

e. Small groups engage in discussion 1 2 3 4 5 6 1.,. 

f. Students ask questions I 2 3 4 5 6 7 

g. Real or simulated learning siluarions 
(e.g., case studies, role playing, 

field visits) 1 . 2 3 4 5 6 7 

h. Planning or evaluating this 

educational program 1 2 3 4 5 6 7 

The next two questions deal with aides and volunteers who work in the classroom. If you have no relevant experience, 
skip question 44. 

43. (Instr., 29A) There arc many different duties which may be performed by an aide or volunteer. What proportion 
of the aide's time should be spent performing these duties? 

a. Clerical % 

. b. Housekeeping % 

c. Child care % 

d. Instructional % 

e. Other (specify: ^ 
) % 

Total = 100% 

O 9A • 
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44. (Instr. 30A) 11 the aide or volunteer perforins in an insiruciional role, what proportion of the aide's instructional 
time should be spent working with students in these ways? 



a. Individual tutoring .... % 

b. Working with sm;ill 

groups :-.-;v . ; r. %" 

c. Tcachirjg class as 

a whole % 

Other (specify: 



' . % 

Total - 100 % 

45. (Instr, 32 A) How important should helping students with personal and vocational problems be in the teacher 
role? 

Not Very 
Important Important 



46. (Instr., 59A)„There are many possible goals that an ABE program might help adult students to achieve. /?an/? the 
goals below in terms of their importance to you by writing the number / in the space next to the most important 
goal, number 2 next to the second most important goal, and so on for all six goals. 

ABE Goals Rank 

d. Increased seH'-confidence of students 

b. Completion of 8th grade equivalency L. ' 

c. Increased competency in language skills 

d. Preparation for high school equivalency exam 

e. Increased ability to cope with adult-lile 

roles and problenis ' 

f. Prepare students to meet special short-term 

goals (e.g., complete lob application) ■ 

g. Other {specify: \ ) ■ 
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The remaining items deal with current practice related to instruction. 

47. (Instr., 12B) What is the current proportional distribution of ABE classroom facilities between the following types 
of locations? 

J. Aduit education center used for clustered classes day and evening % 

b. Scattered classes in school buildings, after school % 

c. Scattered outreach classes in facilities of co-sponsors % 

d. Other {specify: . _) % 

48. (Instr., 13B) In every program, someone has primary responsibility for orienting new students to the program. In 
your program, who now has this responsibility (check one)? 

r. 

a. Director ' ' 

b. Teacher 

c. Lab Instructor 
. d. Counselor 

c. Aide 

f. Other (specify: 

• ) 

0 

- 95 



49. (Inslr., MB) OHen, ABC programs make an miiial assessment of sludeni's achievement level. How is student 
entrance level currently assessed \check one)? 



Assessment Method 

ji. Sundardi^od test 

b. Uoc.illy developed tost 

c. Inte/vtew 

d. Combination oC above 

e. No assessment made 
t. Other (specify: 



50. (Instr., 15B) Regarding ihc iniiial assessment of siudeni skill level, who now makes this assessment (check one)? 

Staff Member 

_______ a. No one 

b. Counselor 

c. Director 

d. Teacher 

e. Aide 

f. Lab instructor 

■ g. Other(speciry: 



51. (Instr,, 16B) Regarding the adminislration of diagnostic placement tests, when are these /70w administered (check 
one)? 



a. Never 

b. Al time of enrollment 

c. After enrollment, when student is ready 



52. (Instr., 17B) Regarding the. evaluation of student progress, how is student progress ciyrre/7//y evaluated (check 
one)? - 



Evaluation Method 

a. Standardized achievement test 

b. Teacher summary evaluation 

c. Classroom tests 

d. SlalT conference 

c. Combination of above 

f. Other (specify: 
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53. Instr., 1 8B) Wh.u records of student progress in the ABE pi, ?gram(7re kept on file 

J. CIdsiroom test scorus 

b. Standardized achievement lest scores 

c. Teacher summary evaluation 

/ " " 3" d. Oilier (specify: ' ' ' J\ * ' ~ 

■ ) ■ 

54. (Instr,, 19B) To what uses are student records put (for regular classes, learning lab, other sources)? 

a. Measure student progress in program 

b. Place students in classes 

c. Counsel students 

d. Rtfer students to other programs 
(educational), employers, etc. 

e. Other (specify: 

) 

55. (Jnstr., 34) Is any part of the instruction provided In your program Individualized, that is, individually prescribed 
and placed? 

Yes No 



56. (Instr., 35) If yes, is such instruction provided in a more or less self-contained learning lab? (A learning lab is a 
separate instructional facility utilizing programmed materials and in some cases instructional equipment designed 
to enable studeniji to work individually at their own pace.) 



Yes No 



57. (Instr., 36) If you have a learning lab, who is in charge of this facility? 



(Name of Lab Supervisor) 

58. (Instr., 63B) Approximately how much gain in grade level actually occurs for typical students at the beginning, 
intermediate, and advanced levels for every 100 hours of instruction (e.g., 1/2 grade level in reading, 1/4 grade level 
in math)? 

Beginning 

Intermediate 

Advanced 

59. (Instr, 65) How satisfied arc you with the extent to which your instructional program enables students to: 

Not Very 

Satisfied Satisfie d 

Gel a iob , ] 2 3 4 5 6 1 

Go into .1 job-training program 1 2 3 4 5 6 7 

Go on to rurthcr education 1 2 3 4 5 6 7 

Achieve personal goals I 2 3 4 5 6 7 

Achieve educationally 1 2 3 ^4 5 6 7 
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Part 5: Collaboration 



The items in this part deal with your a/rre/?/ practice related to collaboration between your ABE program and outside 
organizations that co-sponsor classes and refer students. 

. 60,. (Col,, I B). Approximately \yhat proportion ot y^ budget and of your administrative time \s currently 

. allocated for collaboration with outside organizations? ■ 

a. Budgcl % 

b. Adminisiralivo lime % 

61. (Col., 4) During the pjst year, have you employed staff members whose primary responsibility is to act as a liaison 
between the ABIE program and the community? 

Yes No 

/f'yes, how many (fill-time equivalent)? f.t.o. 

62. (Col., 5) If yes, listed below are several functions commonly performed by liaison personnel. Rank the importance 
pr these liaison functions for your own program by writing ihe number / in the space to the most imporiant 
function, and so on for all functions listed. Add any other functions performed by liaison personnel in your 
program. 

Rank in Order 

Liaison FuncUons of Importance 

... . , . a. , Rcctuiiing siudcrUb ; 

I). Following up dropouts 

c. Providing feedback oti tlie success 

of the ABE program in the communiiy 

d. Establishing co-sponsotship - 

c. Olher (specify: ' ) 

63. (Col., 6) Have you and your staff experienced any major conflict or problems in working with other organizations 
that co-sponsor classes, refer students, or sponsor their own ba.sic education classes? 

. Yes No . 

64. (Col., 7) /f yes, describe the major problems in working relationships and why they seem lo occur. 



65. (Col., 8) During the past year, to what extent has your program experienced difficulty in establishing contact with 
potential co-sponsors and agencies that refer students? 

Little or Great 
No Extent Extent 
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66: (Col., 9) Co-sponsored classes may terminate for any number of reasons. Rank the following reasons for 
terminating according lo ihcir frequency in your own program by writing the number / in the space next to ihc 
most frequent reason for termination, number 2 next to the second most frequent reason, and so on for all reasons 
listed. Add any other reasons why co-sponsored classes are terminated in your program. 

_ ■ ?^3Jik i'l Order 

~ " " R ea so n f o r Ter in ina t i on " of Frequency 

a. EnroUmcnl declines bolow the minimum 

needed lo continue class 

b. The educational needs of ibe co-sponsor 

, are met and classes are no lonjief needed 

c. A teacber cannot be found to instruct the class .... 

d. The co-sponsor, makes demands or, the program 

that are too costly to meet 

e. Other (specify: ) ....... 

^67. (Col., lOB) Listed below arc some benefits that ABE programs may gain from co-sponsorship of classes and 
collaboration with agencies that refer students. Rank the importance of the benefits that your program ac/£/tf//y 
receives by writing the number / in the, space next to the most important benefit, number 2 next to the second 
most important benefit, and soon for all benefits received: 

Rank in Order 

Benefits of CoHaboration ' of Importance 

a. Recruitment of students through co-sponsored 

classes 

b. - Provision of support services by collaboriiling 

- organizations (e.g., ^child care, counseling, - 

Iransporlaiion) 

c. Extension of ABE to hard-to-reach segments of the 

— target population through co-sponsored classes . . . 

d. Increased public awareness of program through 
co-sponsorship and collaboration with referral 

agencies 

e. Obtaining additional operating funds through 
co-sponsorship arrangements 

f. Provision of feedback about "our program through 
interaction with collaborating organizations 

g. Increased community support for ABE through 

■ ■ 'collaboration with other organizations 



68. (Col., 12B) Listed below are five disadvantages sometimes incurred by ABE programs as a result of co-sponsorship 
of classes and collaboration with agencies that refer students. Rank the magnitude of the disadvantages that your) 
program actually incurs by writing the number / in the space next to the greatest disadvantage, number 2 next to' 
I he second greatest disadvantage, and so on for all disadvantages incurred. 

' Rank in Order \ 

j of Magnitude of ■ 

Disadvantages of Collaboration Disadvantage 

a. Loss of program flexibility as a result 

of collaboration "... 



* b. Decrease in .idminisirativ^ autonomy .is .i 

result of collaboration 

c. Collaboralion results in serving students not 
representative of target population the program 
is trying to reach •. . 

d. Increase in unit cost (per instructional hour) 
as a result of collaboration 

c. More of your time than desivable spent on 
arranging for and administering collaborative 
efforts 

(d 99 
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Part 6: Goal-Setting 



The items in this part deal with your current practice related lo the process by which decisions about goals, priorities, 
and policies for the ABE program are made. 

69. (Goal, IB) WhaTpcrsoris or groups^a^^^ have the most influence on settin'g local ABE program goals? {■ - 



70. (Goal, 2B) What role does each person or group typically play in the current goal-setting process? 



71. (Goal, 4B) There are a number of factors that can influence goal-setting and program priorities. Indicate lo what 
extent each factor listed below actually influences the goals and priorities of your program. 

j Extent of Influence 

Little 

Factors ' o r None Great 

J. State ABE pljn 1 2 3 A 5 6 7 

b. General popuUition charjcteristics 12 3 4 5 6 7 

c. Other ABE programs in the community 12 34567 

d. Expectations of participants I 2 3 4 5 6 7 

e. Relations with school systems 12 3 4 5 6 7 

f. GEO exam I 2 3 4 5 6 7 

g. Expectations of the community I 2 3 4 5 6 7 

72. (Goal, 5) In what specific ways has the state plan actually influenced program goals and priorities? 



73. (Goal, 38) In what ways do working relationships between the ABE unit and collaborative organizations cwrren/Zy 
influence the goal -setting process? 



74. (Goal, 6B) What does your ABE unit currently have by the way of a written statement of goals? 



75. (Goal, 7) Which of the following policy decisions related to program goals and priorities have actually been made 
or modified during the past year or so in your local ABE prd^ram? (Check all that apply.) 

, Definition of target population 

Selection of Student recruitment strategy 

Formulation of criteria for staff selection 

Determination of relative emphasis on various instructional areas •* 

Determination of strategics for obtaining community support 

: Decision on degree of ccnlrali;{at)oM vs. dvcvrdru\}/,iXt}on of class location;, 

Policy related to collaboration with community groups and organizations 

■ Other (specify; 



For each policy decision checked, complete a copy of the Goal-Setting Process Form. 
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Teacher Questionnaire 

Instructions to Respondents 

This questionnaire is pari of an evaluation study. The purpose of the study is to provide information that v/ill be useful 
in"improving your ABE program,. 

Your responses will be kepi strictly confidential. You need not sign your name on the completed questionnaire. All 
results will be repprted in summary form. 

You will find that many items in this questionnaire contain two parts, e.g., 2A, 2B. One part refers to intended 
practice— what should and could take place, e.g., should ABE teachers place great emphasis on teaching coping skills? 
The other part of the item refers to current practice-what actually happens in the classroom or the program as a whole, 
e.g., do you now place great emphasis on teaching coping skills? 

This questionnaire should take about 30 minutes to complete. Please do not discuss the questions with your colleagues. 
Feel free to write your responses in your own words If the forced choice options do not fit your situation. 

Your contribution to this study is vitally important. 

Sample Items 

CHECKMARKS: Place checkmark on the line in front of the appropriate answer. Unless otherwise specified, 
make a checkmark in one space only. 

Sample #1 : 

Do you currently teach in an ABE program? 



SCALES; Circle one number only. If a question contains more than one scale, circle one number /W eac/? 

scale. 

Sample #2: 

Please indicate the extent to which you agree or disagree with the statements below. 

Di 



ABE should be limited to adults over 16 1 
ABE students should be charged tuition 1 
PROPORTIONS: Write in the proportion (percent) in the appropriate space. Column totals should equal 100%. 
Sample #3: 

What proportion of your students is in each age category below? 

Age Category ?roport\o{\ 

under 20. . 

20-29 

30-39 

40-19 

50 or older 

Total = 100% 




Agree 

2 3 4 5 1 
2 (£) 4 5 6 7 



10% 
35% 
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RANK ORDERING: Rank all Hems Ifslcd, assigning I to the highest rank, 2 lo the next highest, 3 to the third 
highest, and so on lor all items. 

Sample #4: 

Rank" order the irriportancc tc you of each of the following renovations by writing ! in Ihor 

space next to the most import. mt renovation, 2 next to the second most important, and 3 next 
to the third mosrimportani. 

New lighting. 3 

• More blackboards .... ^ 
New, larger desks .... ^ 
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Part 1: Staffing 



1. (Staff., 9) When you were first hired as an ABE teacher, what had been your previous occupation (check one)? 

a. f:niploycd by a'puhllc school system 

b. Employed in business oi industry 

c. Employed as a housewife 

d. Employed in some oiher capacity (specify: ) 

e. Unemployed 

2. (Staff., 15) This question is concerned with your relationships with other teachers and staff members. For each 
category of staff member listed below, indicate whether your general relationship with jtaff in that category is very 
satisfactory, moderately satisfactory, or unsatisfactory (circle number in appropriate column). 

General Relationship 

' Not Unsatis- Moderately Very 

Staff Category Applicable factory Satisfactory Satisfactory 

a. Qj/licr Teachers 0 t 2 3 

b. Aides 0 1 2 3 

• c. Counselors 0 1 2 3 

d. Supervisors 0 1 2 3 

e. ABE Director 0 I 2 3 

3. (Staff., 16B) All things considered, how satisfied are you with your present position as an ABE teacher (check 
one)? 

a. Very Satisfied 

b. Moderately Satisfied 

c. Dissatisfied 

4. (Staff., 17B) How would you characterize your personal commitment to the goals of this ABE program (check 
one)? 

a. Highly Committed 

b. Moderately Committed 

c. Uncommitted 
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Part 2: Instruction 



5. (Instr., 11) Concerning the materials you use in your class: 

A. Whdl proper- What propor- 

tions should be: lions arc: 

a. Commcrcidlly published 

b. Prepared or adapted by 

yoursell 

c. Prepared or adapted 

locally 

6. (Instr., 13) In every program, someone h:\sphimary responsibility for orienting new students. 

A. In your pro- B. 1 n your pro- 
gram, who should , 'ram, who now has 
have»lhis responsibility? ih's responsibility? 
(check one) (check one) 

Staff Member 

a. Director 

b. Teacher 

c. Lab instructor 

d. Counselor 

e. Aide 

f. Other (specify: 



7. (Instr., 14) Often, ABE programs make an initial assessment of the student's achievement level. 



Assessment Method 

a. Standardi/fd test. 

h. Locally developed test . . . 

c. Interview 

d. Combination of above . . . 

e. No asscsv-ment 

I. Other (specify: 

_) 



A. How should student 
entrance level be assessed 
(check one)? 



B. How is student entrance 
level currently assessed 
(check one)? 



8. (Instr., 15) Concerning this initial assessment: 



A. -Who should make 
this assessment 
(check one)? 



B. Who now makes 
this assessment 
(check one)? 



Staff Member 

a. No one 

b. Counselor 

c. Director 

d. Teacher 

e. Aide 

f. Lab J nsirucior 

i;. Other {spfcify: 

) 
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y. (Instr., 16) Kcj'arding the administration of diagnostic placement tests: 



d. Never 

b. A I Ihe lime ot cm ollmenl 

c. A t ier cnrollmeiil, 

when siudeni is ready . . . 



A. When should 
these tests be 
.idministered 
(check one) ? 



B. When arc these 
tests now 
administered 
(check one)? 



10. (Instr., 17) Regarding the evaluation of student progress: 



Evaluation Method 

a. Classroom tests 

b. Standardized achievement tests . . 

c. Teacher summary evaluation .... 

d. Staff conference 

e. Combination of above 

f. Other (specify: 

) 



A. How should 

student progress be 
evaluated (check one)? 



B. How is student 
progress currently 
evaluated (check one) ? 



I I. (Instr., 18) Regarding records of student progress: 

A. What records B. What records of 

should be kept . student progress are 

(check as many kept on file (check 

as apply)? as many as apply)? 

Student Records 

a. Classroom test scores 

b. Standardized test scores ....... 

c. Teacher evaluations 

d. Other 

(specify: ) 

(specify: ) 

12. (Instr., 20B,.21B, 22) If you use standardized achievement tests, are they administered at regular intervals? 

. __ .Yes No 

A. If yes, at what intervals? (check one) a. 100 hours of instruction 

b. 150 hours of instruction 

' c. 200 hours of instruction 
d. Other (specify: ) 

B. Names of tests 



ERIC 



105 



13. (Inslr., 63A) Approximately how much gain in grade level do you expect for typical students at the beginning, 
intermediate, and advanced levels (or every 100 hours of instruction? (e.g., 1/2 grade level in reading, 1/4 grade 
level in math) 



a. Beginning 

b. Intermediate 

c. Advanced 



14. (Instr., 23) Most teachers emphasize some subjects more than others. 

A. ir you woic (roe lo decide, how much 
enipiuisi^ would you give to each of 
the tollowiiij; subjects? 

Little or Great 
ABE Subjects No Emphasis Emphasis 

a. Arithmetic........ 12 3 4 5 6 7 

b. Reading, lan.nua^e skills .... 1 2 3 4 5 6 7 

c. Health education I 2 3 4 S 6 7 

d. Consumer educalion I 2 3 4 5 6 7 

e. Social studies, civics 1 2 3 4 5 6 7 

I. Ethnic or racial heriiai;e .... I 2 3 4 5 6 7 

i*. Coping (how to apply 
for a job, obtain legal 
assistance, deal vvitii 

landlords) I 2 3 4 5 6 7 

h. Other (specify: 

) I 2 3 4 5 6 7 



li. In your own ABE teaching, how much 
emphasis do you actuaUy give lo each 
of the following suujccts? 



Little or 
No Emphasis 



Great 
Emphasis 

6 

6 

6 
6 



15. (Instr., 24) Instruction can be given to the class as a whole, or students can be grouped according to their 
problems, interests, or characteristics, or stud^^nts can be taught individually. 



A. In each of your classes, what is the approximate proportion of time that 
should be devoted to each of these mv^thods of instruction? 



- Type 
of Class 
Class (e.g. ESL) 



n 
n 



Number of 
Students 



hitended Proportion of Class Time 



Teach 
Class as 
A Whole 



Teach 
Students 
in Groups 

% 



Teach 
Students 
Individually 



1 00% 
1 00% 
1 00% 
1 00 /o 



Exclude from consideration all class time not actively devoted to 
instruc^i.^n. Indicate about what proportion of that instructional' lime 
is devoted lo these different methods of instruction. 



Actual Proportion of Class Time 



Tea ch 



Yeach 



of Class 
(e.g. ESL) 


Number of 
Students 


Class as 
A Whole 

% 


+ 


Students 
in Groups 

% 






% 


+ 








% 


+ 


% 










% 



Teach 
Students 
Individually 



1 00% 
100% 
100% 
100% 
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iVUnhoJs ot insii Liction may be adapied lo accommodaic differences among siudenis. 



16. (Instr., 25, 26) Do you adapt your methods of instruction to accommodate diffei'ences among students? 

Yos No 



Methods af 
Instr uction 

a. Personally tutor 
huiiviilual students . . . . 

b. G! on p s t u d e n ts w i \ li 
similar problems or 
ifiietesis '.ojieiher . . . . 

c. Senil student lo 
learnin.u Uh 

d. Make individual leading, 
wrltinv;, or math 
assiv;nmcnts 

e. Use pjoi?ramnied 
jiialerials 

1. Other {specify. 



A. Mow much emphasis do you teel 
should he placed on each of iho 
methods of instruction listed below 
in order to acconinu)date differences 
amonij students? 



Lrttic or 
No Emphasis 



'1 5 

A 5 

A 5 

4 5 

'1 5 



Great 
Emphasis 



(3. tf yoti do currently adapt your 
instruction to accommodate differ- 
ences among students, how much 
emphasis do you place on each of 
the following to accommodaic 
these differences? 



Little or 
No Emphasis 



2 3 

2 3 

2 3 

2 3 



4 5 

4 5 

4 5 

4 5 



Great 
Emphasis 



6 7 

6 7 

6 7 

6 7 



17. (Instr., 27) There are a number of ways thai students participate in their instruction. 



A. To what extent shotdd students B. To what extent do studentb 

participate in each of the foDowinj^ vurrenily pariicipale in each ol 

ways? the following ways? 

Type of Student Little or Great Mttle or 

Participatioti No Extent Extent No Extent 

a. Student recites I 2 3 4 5 6 7 I 2 3 4 5 \ 

b. Pairs or small groups 
of students practice 

skills together I 2 3 4 5 6 7 I 2 3 4 5 

c. Small groups engage in 

problem solving I 2 3 4 5 6 7 I 2 3 4 5 

J. Whole class pariicipaies 

in discussion I 2 3 4 5 6 7 I 2 3 4 5 

c. Small groups engage 

in discussion 1 2 3 4 5 6 7 \ 2 3 4 5 

f. Students ask questions I 2 3 4 5 6 7 I 2 3 4 5 

g. Real or simulated 
learning situ.itions 
(e.g., case studies, role 

playing, field visits) 1234567 12 34 5 

h. Planning or evaluating 
this educational 

program _.l 2 3 4 5 6 7 I 2 3 4 5 

18. (Instr., 28) Is there an aide or volunteer who works with you in your classroom? 

Yes No 



Great 
Extent 



[If nOf skip lo question 23.) 
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19. (Instr., 29) There are many dilTcronl duties which may be performed by an aide or volunteer: 



A. Whal proportion of your aide's 
lime shoiikf be spent performing 
rncsc duties? 



Duties 

a. Clerical ; 

b. ' Housekeeping , 

c. Child care 

d. Inslruclional 

e. Other (specify: 

) 



B. What proportion of your aide's 
lime is currentfy spent performing 
tlH-sc duties? 



% 

, % 



% 

Total = 100% 



Total = 10091 



20. (instr., 30) ff the atdc or volunteer performs in an instructional role: 



A. What proportion of his/her 
instructional l\m\i should bo 
spent working with students 
in these ways? 



a. Individual tutoring . 

b. Working with small 

groups 

c. Teaching the class 

as a whole 

d. Other (specify: 

) 



.% 
.% 



Total = 100% 



B. About what proportion of your 
aide's instructional time is 
currentfy spent working with 
students as follows? 



% 



Total = 100% 



21, (Instr., 31) If the aide or volunteer performs in an instructional role: 



A. How important to the educational 
e^fecflveness of your c/jssroom should 
he or she be? 



B. How important to the educational 
effectiveness of your classroom is 
assistance of your current aide? 



Not 
Important 



Very 
Important 



Not 
Important 



Very 
Important 



22. (Instr., 32) In addition to performing an instructional role, teachers may help students with personal and 
vocational problems. 



A. How important should helping 
students wilh personal and 
vocational problems be in your 
role as teacher? 



B. In actual practice, how important 
to your role as teacher is helping 
students wilh personal and 
vocational problems? 



Not 
Important 



Very 

Important 



Not 

Important 



Very 
important 



o 
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23. (Iiistr., 33) Tejcliers may talk privately with students about personal or vocational problems. 



A; In a typical month, how many 
stiidcMits .<,//c;///f/ you talk with 
privately on personal and 
vocational problems? 



Within the last month, about how 
many students //t/ir yo// talked 
10 about their personal and 
vocational problems? 



._. . Studtnis 



^ Students 



24. (Instr., 35, 37) In some ABE programs there is a learning lab v^hich is a separate instructional facility utilizing 
programmed materials and in some cases instructional equipment designed to enable students to work individually 
at their own pace. Does the learning lab play any part in your students' instruction? 



Yes 



No 



A. What pari sfwufd it play in 
their instruction (check one)? 



a. Used tor remedial 
work for students 

referred by me 

b. A regular part of the 
students' total program 

c. Available to students 

who want it 

d. None 

e. Other (specify: 

) 



25. (Instr., 38) Concerning student work in the learning laboratory: 



B. If yes, what part does it play 
in their instruction (check 
one)? 



A. How should work in the 
learning laboratory be co- 
ordinated with your classroom 
instruction (check one)? 



If yes, how /5 work in the 
learning laboratory co- 
ordinated with your classroom 
instruction (check one)? 



a. Students' lab work 
prescribed by me ... . 

b. All my students' work 
prescribed by the 
counselor 

c. All my students' work 
. prescribed by the 

lab instructor 

d. Conference between 
myself, lab instructor, 
and/or counselor . . . . 

e. Not coordinated in 
any specific way . . . . 
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26. (Instr, 59) There arc nuny possible goals lhal an ABIZ program mighi help sluclenls achieve. 



A, Hank the goals below jccord^ 
ini; to the liegf ee of einph.isis 
you led should be placed on 
them by willing the number / 
in the space next lo the most 
imporlani goal, number 2 next 
to Ihe second mosi important 
goal, and so on lor all six goals. 



B. Runfi the goals below accord- 
ing to the degree of emphasis 
uifituHy [)laced on them by 



wrilini; the number / in the 
space next to the goal given 
Ihe mosi emphasis, number 2 
next to the goal -given the 



second most emphasis., and so 
on lor all six goals. 



Goals of ABE Instruction 



Rank 



Rank 



a. Increased scU-conlidence 

ol sludents 

b. Completion of 8ih grade 

oqui valency ^ 

c. Increased competency 

in language skills • 

d. Preparatiofi for high 

school equivalency exam . . . 

c. Increased ability to 
cope with adult-life 

roles and problems . .■ 

f. Prepare students to meet 

special shori'lcrm goals - • y 

(e.g., complete job 

application) 

g. Other (specify: 



27. (Instr., 63B) Approximately how much gain in grade level actually occurs for typical students at the beginning, 
intermediate, and advanced levels for every 100 hours of instruction (e.g., 1/2 grade level in reading, 1/4 grade level 
in math)? 



28. (Instr., 64) Approximately what proportion of your enrolled students are absent at any one class meeting? 



29. (Instr., 66) What suggestions do you have about ways to Improve instruction in your ABE program? 



Beginning 

Intermediate 

Advanced 



less than 10% 
10-24% 
25-49% 
50% or more 
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Part 3: In-Service Education 



30.. (In-Ser. Ed., 5B) Listed below are six approaches that may be incorporated in an organized program of in-service 
education. For each approach listed, indicate (I) the exieni lo which this approach has been emphasized in your 
own in-service education in this ABl: program and (2) the value of the experience for you. 

No Great No Great 

Emphasis Emptiasis Value Value 

a. Assisnmcnt to work in 
I he classroom ol a 
more experiencetl 

teacher I 2 3 4 5 6 7 I 2 3 ^ 5 6 7 

b. Parlicipalion in 
curriculum 

developmcnl j 2 3 4 5 6 7 I 2 3 4 5 6 7 

c. Coaching by supervisors 

or others 1 2 3 4 5 6 7 1 2 3 4 5 6 7 

d. Workshops and 
conferences conducted 

by local ABE program 1 2 3 4 5 6 7 1 2 3 4 5 6 7 

e. Workshops and 
conferences conducted 
by others outside 
your local ABE 

program 1 2 3 4 5 6 7 I 2 3 4 5 6 7 

f. Participation in 
university courses 
related to your work 

in ABE .1 2 3 4 5 6 7 I 2 3 4 5 6 7 

g. Other (specify: 

• ) 123456 7 1234 5-6 7 

31. (In-Ser. Ed., 21) In the past year, about how many days have you devoted to participation in organized in-service 
education activities? 

Days 

32. (In-Ser. Ed!, 22) Concerning pre-service and in-service training for aides and volunteers: 

At. Should an aide or [3 1. Has your aide or 

volunteer receive volunteer received 

such training? pre-service or in- 

service training? 

. Yes No Yes No 

A2. If yes, should XcazUqxs B2. //^'Ci-, were you also 
also attend these in attendance at these 

training sessions? training sessions? 

Yes No Yes No 



O ni 
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33. (In Ser. Ed., 24B) To what exieni is each of the following a maior outcome of current in-service education 
activities? 



V 



Little or 
No Extent 



a. Higher siatt morale . . . 

h. Greater insii^ht into 
sluilents 

c. 1 Increased professional 
competence 

U. Greater receptivity to 
Cm II re iivservice 
eilucalion 

e. Increased competence 
ot trainers . 



2 3 

2 3 

2 3 

2 3 

2 3 



Great 
Extent 
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student Questionnaire 



Directions for Teachers; 

1. Please inform your stuclcnis that a study is being conducted to help improve the program. The students themselves 
are not being evaluated, nor are they asked to evaluate you. All students are being asked to complete a questionnaire 
thai asks for their opinions. The questionnaire is anonymous. Students do not have to sign their names. 

2. Distribute the questionnaires to all students present. If necessary, read the questionnaire aloud to the class. Remind 
students to check only one answer to each question. 

3. Please assist any students who are having difficulty completing the questionnaire. 

4. After all students have completed the questionnaire, ask one student to collect them. Place the completed 
questionnaires in the pre-addressed envelope and return them to the administrative office. 



113 




Directions 

This quest ionn^iire asks what you thing about your adul! education classes. Please say what you really think. You do 
not have to sign your name. Nobody will know who answered this questionnaire. 

1. (Instr., 60) There are many reasons why adulth wan( to get more education. What is your own most important 
reason for coming to adult educaiion classes? (Please check only one line.) 

To be able lu help my children with their schoolwork 

To gel a job or a better job 

To learn the English language 

To gel a high school equivalency diploma 

To improve myself by learning more 

Other— not listed above 

2. Instr., 61) If your answer to the last question was Other, what is the reason? 



3. (Instr., 62) Considering your most important reason for improving your education, how much are those adult 
classes helping? (Please check on/y one line.) 

The classes are not helping at all 

The classes are helping me some, but not enough 

The classes are helping mc a lot ... 

4. (Instr,, 56) Arc you treated like an adult, in these classes? 

Yes No 

5. (Instr., 57) Are ihcse adult education classes relaxed and friendly? 

. Ye s N o 

6. (Instr., 58) Mow do you feel about learning in theses adult classes? (Please check only one line.) 

It is very hard. 1 am having a lot of trouble. 

ll is sometimes hard, but I don'l have too much trouble. 

ll is not hard. 1 don't have any trouble. 

7. (Instr., 66) If you have any suggestions about making this adult education program better, please write them here. 
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Co-Sponsor Questionnaire 



Directions: 

This qucslionnairc shouid be complclcd by ihc person in 
you co-sponsor with Ihc ABE program. 

1 . What is the title of your organization? 



your organi/alion who is most familiar with the classes that 



2. What is your organization's business, purpose, or function? 



3. What is your position within your organization? 



4. To what extent were you personally involved in establishing ABE classes in your organization? 

I was not I was Involved 

Involved to a Great Degree 

1 2 3 4 5 6 7 

5. To what extent does your organization become involved in the day-to-day operation of ABE classes? 

Is not Is Involved to 

Involved a Great Degree 

1 2.3 4 5 6 7 

6. How did your organization determine that it needed ABE classes? (Check as many as apply.) 

An investigation of employee or membership records indicated a large number . • 

of undereducated adults. 



My organization's employees, membership, or clients requested ABE classes. 

My organization felt a need to upgrade employee skills. 

My organization contains a significant number of non-English speaking adults. 
ABE was needed to facilitate communication. 

My organization had not considered ABE, but the ABE director or his representative 
convinced us that it was a good idea. 

Other (specify) 



7. Very briefly, how did your organization first learn of the ABE program? 
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8. (if an employer) do you offer your employees released time from work with pay to attend ABE classes? 



Yes 

• No 

Does not apply 

9. How successful have ABE classes been in accomplishing any of the following for your organization? 



Upi^rdtMng employee, 
member, or clleril 
skills 



Incrc.isiiig employee, 
client, or mcmhcrsliip 
proriciency in speaking 
English 



building an esprit 
do corps among your 
membersiiip, clients, 
or employees 



Affording membership, 
clicn».s, or employees 
the opportunity to 
rise within your 
organization 



Not Imporiani 
for our 
Organizatioti 



ABE Classes 
Have Had 
No Success 



ABE Classes 
Have Been a 
Great Success 



3 4 5 6 7 



12 3 4 5 6 7 



10. in what ways has the ABE program most benefited your organization (list)? 



11. Have there been any significant drawbacks to co-sponsoring classes with the ABE program? 

Yc"s No 

12. If yes, please list: 



1 3. When problems arise concerning ABE classes, whom do you usually contact? 



The ABE Director 
Other (specify: _ 



The Teacher 



14. How would you rate the effectiveness of the ABE teacher? 



Unsatisfied 



Very Satisfied 
6 7 



I am unable to 
rate the ABE 
teacher's 
effectiveness 
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15. In general, how satisfied with the ABE classes are the adults from your organization who participate in them? 

Unsatisfied ^ Very Satisfied I have no 

1 2 3' 4 5 "g 7 ^"^"^.^^f , 

knowledge of 

their satisfaction 



16. When you decided to provide basic education classes for your membership, employees, or clients, why did you 
choose the ABE program (check as many as necessary)? 

; Belief that the ABE program is the best available program providing basic education 

in our community. 

» 

The ABE program provides its service free of charge. 

The ABE program was the only basic education program that we knew about. 

Our membership (clients, employees) wanted the A6E program. 

Other (specify: ) 



17. Additional Comments: 
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Forms 



This section provides the basic forms )or collecting evaluation data. Each lorm is organized to collect data from a 
specified source, as follows: 



Form 

Program Statistics Form 

Student Data Form 

Teacher Data Form 

Teacher Rating Form 

In-Service Education Conleni Form 

Administrative version 

Teacher version 
Classroom Interaction Rating Form 
Co-Sponsor Data Form 
Goal Setting Process Form 



Source 

Program records 

Annual report or student records 
Teaching staff or personnel records 
Director or supervisor 

Administrators 
Teachers 

Observation in. classrooms 
Appropriate administrator of ABE unit 
Director 



If a form seems \ye((-suited, arrangements can be made for copies. If a form does not seem to fit, however,, it should be 
modified so that it docs. In making such changes, try to preserve the parallelism between the items on current practice 
in the forn)s dnd quej»lionnaircs and the items on intended practice in the interview guides. 
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Program Statistics Form 



Some of the following can be obtained from program records: 

I. (Rec, 12) What is your best estimate of the max' ^ number of potential students in 
your cily or service area? 



2. (Rec, 13) What is the approximate total number of students who currently participate in your 
ABE program in a typical week? 

3. (Rec, 14) Whai was your total annual enrollment for each of the past four years? 

Total Annual 
Enrollment 



4. (Rec, 15B) By the i;ixth week of class, beginning last fall, what proportion of the students who 
were enrolled at the first week were still active? % 

5. (Instr., 1) How many teachers do you employ? 

6. (Instr., 2) How many teachers are: 

Part time (less than 20 hours per week) 

Full time (20 or more hours per week) 

7. (Staff., 18B; Instr. 3) What is your annual rate of teacher turnover? 

a. 25% or more 

b. .__ 10-24% 

c. less than 10% 

8. (Instr., 4) How many classes are currently in operation? 

9. (Instr., 5) How many classes are: 

ESL 

Basic education (native born). . . . 

Mixed 

GED 

Other (specify: 

10. (Instr., 6) How many classes are held: 

In public school facilities 

- In other locations 



Year 

Last'-year 

19 

19 
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II. 



(Instr., 7) How many classes arc held: 

During the day (before 5 p.m.) ' 
In the evening (after 5 p.m.) 



12. 



(Instr., 8) In practice, what is the minimum enrollment required for a class to continue? 



13. (Instr., 9) How many hours per week do classes usually meet? 

14. (Instr., 10) What is your current operating budget? $ 

15. (Instr., 21 B, 22) If standardized achievement tests are administered at regular intervals in. your 
program, please provide the following information: 



B. Names of tests: 



(Note: If results of these achievement tests have been analyzed for your use, please attach copy.) 

The following materials will aid in evaluation and should be supplied if they are available: 
A copy of your state plan 

A copy of the most recent Annual Program Report 

A statement of program objectives if they have been written down 

A copy of your budget 

A copy of any recent program evaluation reports 
Cooies of materials used for student recruitment 

)ob descriptions (if written) for the director, teachers, counselors, supervisors, aides, and other staff 
Evaluations of reLeni in-ici vict; education sessions 

A representative smaple of curriculum guides and instructional materials actually in use 
Coptesof any dropocii studies 



A. Intervals between 
lest administration 
(check one) 



a. 100 hours of instruction 



b. 150 hours of instruction 

c. 200 hours of instruction 

d. Othor (specify: 
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student Data Form 



ii data for Annual Program Report required by the Adult Education Act of 1966 are tabulated and current, secure a 
copy of the report; otherwise, obtain the following data from student records, or, in a large program, from a random 
sample of student records, 

Total number of students or 

total In sample 

1. By approximate grade level: 

a. Beginning (1-3) 

b. Intermediate (4-6) 

c. Advanced (7-8) ^ . 

d. GED (H.S. Equiv.) 

2. By sex: 

a. Male 

b. Female 

3. By age range: 

a. 17 or less 

b. 18-24 

c. 25-34 

d. 35-44 

e. 45-54 

f. 55-64 

g. 65 and over 

4. By race: 

a. White 

b. Black 

c. American Indian 

d. Oriental 

e. Other non-white 

5. By ethnic group: 

a. Cubans ' 

b. Mexican-Americans 

c. Puerto Ricans 

d. Other 

' 6. Migrant 

7. Welfare recipients (estimate) 
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Teacher Data Form 



Please complete this form in its entirely. It is designed to give basic information on the instructional staff of this ABE 
program. Pleace circle the appropriate answer. 

A. Name: 

Address: 

Class location: 

Dale: 

B. Type of class I teach: 

1. ESL {English as a language) 3. Both ESL and Basic Education 5. Other • 

2. Basic Education for Native Born 4. Learning lab only 

C. My professional background is in: 

1. Elemcniary Education (K-6) 3. Other education specialty (specify: ) 

2. Secondary Education (7-12) 4. Other 

D. My eihnic background is: 

I . White 2. Black 3. Hispano-American 4. Other 

E. . My sex is: 

1. Male 2. Female 

F. My age is: 

1 . Under 35 2. 35-49 3. 50 or older 

G. My employment status in the ABE program is: 

1 . Part time (less than 20 hours per week) . 

2. Full time (20 hours or more) 

H. I have had years of /l^f teaching experience. 



* 
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Staffing 



Teacher Rating Form 

Directions: The director or supcrvisor(s) should complete Section A of this form for each teacher who has a clasr^room 
or laboratory instructionalMssigPinent. Data for Sections B through H may be obtained from items B through H of the 
Teacher Data Form. Only one numbered item in each section should be circled. The number circled should be noted in 
the right margin. 



SECT. 

A 


Overall Performance 

All things considered, how would you rate the overall performance of 

(teacher code number) 

1. Poor 2. Fair 3. Good 4. Very Good 5. Excellent 




B 


Type of Class(es) 

K ESL 3. Both ESL and 5, Other 

^ r% . r- . . Basic Education 
2, Basic Education 

for Native Born 4. Learning Lab Only 


• 


C 


Professional Background 

L Elementary Education (K-6) 3. Other Education Specialty 
2. .Secondary Education (7-12) 4. Other Background 




D 


Ethnicity 

L White 2. Black 3. Hispano-Amcrican 4. Other 




E 


Sex 

1. Female 2, Male 




F 


Age 

1. Under 35 2.35-49 3. 50 or older 




G 


Employment Status 

^. Pdu tinie (less than 20 hours) 2. Full time (20 hours or more) 




H 


Years of ABE Teaching Experience 

1. (1 year or less) 3, (3 years) 5. (5 yuars) 

2. (2 years) 4. (4 years) 6. (6 or more years) 
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In-Service Education Content Form 
(Teacher and Aide Version) 



Directions for Teachers and Aides: 

Listed below are 16 topics which arc often the focus of in-service education activities. All teachers and instructional 
aides should complete the second column on the right, "Current Priority for In-Service Need" for all 16 topics listed. 
If you participated in ABE in-service education during the past year, please complete the first column as follows: 
(1) read through the list of topics and place a checkmark next to those which were dealt with in any in-service edu- 
cation aciW\i\cs you participated in; (2) foi" those topics which you checked, complete the scale on "Past Emphasis in 
In-Service Education" by circling the appropriate number on each scale. 



Note: Indicate your staff role (check one) 



teacher 

aide 

other 
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A 

Past Emphasison 
In-Service Education 

Topics None Great 

, a. ABE program orteniation: 
objectives, procedures, 
current developments, 

plans, reports I 2 3 4 5 6 7 

, b. Differences in teaching 

adults and children 1 2 3 4 5 6 7 

. c. Philosophy o\ 

adult education 1 2 3 4*5 6 7 

. d. Understanding the student, 
population, culture of 
poverty, ethnic group 

differences . - 1 2 3 4 5 6 7 

. e. Course organization: 
content selection, 
scheduling and sequencing 
topics, making lesson 

plans I 2 3 4 5 6 7 

f. Methods of instruction: 
selecting, adapting, 

and using 1 2 3 A 5 6 7 

. g. Instructional materials and 
aids: selecting, adapting, 

and using V 2 3 4 5 6 7 

. h. Diagnosis of student needs, 
testing and evaluating 
achievement; student program 

prescription 1 2 3 4 5 6 7 

. i. Discipline, class control, 

management of student failure^ 

coping with lack of self-confidence 1 2 3 4 5 6 7 

. j. Counseling students in academic 

or personal matters 1 2 3 4 5 6 7 

. k. Working with aides and 

volunteers 1 2 3 4 5 6 7 

I. Student recruitment 

and retention 1 2 3 4 5 6 7 

. m. Individualizing instruction 1 2 3 4 5 6 7 

. . n. Improving human relations: 

teacher-student 1 2 3 4 5 6 7 

. o. Improving staff relationships 

within ABE 1 2 3 4 5 6 7 

. p. Teaching "coping" skills: skills 

of urban living .... 1 2 3 4 5 6 7 
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B 

Current Priority for 
In-Service Need 



Low 



High 



12 3 4 5 6 7 

12 3 4 5 6 7 

1 2 3 4 5 6 7 

12 3 4 5 6 7 

12 3 4 5 6 7 

12 3 4 5 6 7 

12 3 4 5 6 7 

1 2 3 4 5 6 7 

12 3 4 5 6 7 

10'^ * r r 1 

\ ^ J ^ ^ KJ t 

12 3 4 5 6 7 

'12 3 4 5 6 7 

12 3 4 5 6 7 

12 3 4 5 6 7 

1 2 3 4 5 6 7 

1 2 3 4 5 6 7 



In-Service Education Content Form 
(Administrative Version) 



Directions for Administrative Staff: 



Listed below arc 16 topics which arc often the focus of in-service education activities, /^tose complete the first 
column as follows: (I) read through the list of topics and place a checkmark next to those which were dealt wilh in any 
in-service education activities for staff members sponsored or prompted by your ABE program during the past year; (2) 
for those topics which you checked, complete the scale on **Past Emphasis in In-service Education" by circling the 
appropriate r.ii.T.b^r on each scale. Next, please complete the second column to indicate your estimate of the priority 
of need for most ABE teachers at the present time, circling the appropriate number on each of the sixteen scales. 



Past Emphasis on 
In-Service Education 

Topics None Great 

a. ABE program orientation: 

objeclives, procedures, current 

developments, plans, reports 1 2 3 4 5 6 7 

b. Differences in teaching 

adults and children 1 2 3 4 5 6 7 

c. Philosophy of adult 

education 1 2 3 4 5 6 7 

d. Understanding the student 

population, culture of poverty, 

ethnic group differences I 2 3 4 5 6 7 

„ e. Course organization: content 

selection, scheduling and 
sequencing topics, making 

lesson plans 1 2 3 4 5 6 7 

f. Methods of instruction: 

selecting, adapting, and 

using .. 1 2 3 4 5. 6 7 

g. Instructional materials and i 

aids: selecting, adapting, \ 

and using 1 2 3 4 S^-SW 

h. Diagnosis of student needs, 

testing and evaluating 
achievement; student 

program prescription .... 1 2 3 4 5 6 7 

i. Discipline, class control, 

management of student failure, 
coping with lack of self- 
confidence 1 2 3 4 S 6 7 

... j Counseling students in 

academic or personal matters 1 2 3 4 5 6 7 

k. Working with aides 

and volunteers 1 2 3 4 5 6 7 

I. Student recruitment 

and retention 1 2 3 4 5 6 7 

m. Individualizing 

instruction 1 2 3 4-5 6 7 

n. Improving human relations: 

teacher-student 1 2 3 4 5 6 7 

„: o. Improving staff relationships 

within ABE 1 2 3 4 5 6 7 

p. Teaching "coping" skills: 

skills of urban living 1 2 3 4 5 6 7 



Current Priority for 
In-Service Need 



Low 



High 



1 2 3 4 5 6 7 

1 2 3 4 5 6 7 

1 2 3 4 5 6 7 

1 2 3 4 5 6 7' 

1 2 3 4 5 6 7 

1 2 3 4 5 6 7 

1 2 3 4 5 6 7 

1 2 3 4 5 6 7 

1 2 3 4 5 6 7 

1 2 3 4 5 6 7 

1 2 3 4 5 6 7 

1 2 3 4 5 6 7 

1 2 3 4 5 6 7 

1 2 3 4 5 6 7 

12 3 4 5 6 7 

1 2 3 4 5 6 7 



ERLC 



125 



Classroom Interaction Rating Form 



Instructions: 

1. Read each item carefully, lo become familiar with lis conlenl. Tiiis should be done prior lo visits to ABE 
classrooms. Every effort has been made lo v^ord the rating scale descriptions as directly and explicitly as possible, 

2. Before you visit a classroom, you should make certain that the Instructor has been told that someone v^ill be 
visiting his or her class. If on entering a classroom it becomes evident that you were not expected by the teacher, 
excuse yourself and inform the supervisor of the situation. 

3. Ask the teacher to inform the class of I he purpose of your visit, namely, "to find out how ABE classes are taught." 

4. While the class is in progress, do not make notes or refer to your rating form. Only after you have left the 
classroom, enter your ratings on each scale. It is for this reason that thorough familiarity with each scale item is so 
important. 

5. Return the completed form to the evaluation project supervisor. 

1. (Instr., 44) Teachers vary considerably in the extent to which they plan in detail for learning activities. Some 
reachers plan plan every step of the lesson in advance. Others sketch out the major objectives. Still others seem to 
make no advance plans. To what extent did this class's learning activities seem to be planned in advance? 

Major Objectives Every Step 

Seemed Not Seemed to be Seemed to Be 

to Be Planned Planned But Not Laid Out in 

at All Details Advance 

1 2 3 4 5 6 7 

2. (Instr., 45) Some classrooms appear to be open and free. Others are more controlled and regulated. Students may 
participate spontaneously, or only when the teacher clearly expects them to do so. How would you rate this class? 

Controlled: Students ' Open:. Students • 
Participated Only When Spontaneously 

Clearly Expected or toTeacherand 
Required Among Themselves 

1 2 3 4 5 6 7 

3. (Instr., 46) Adult students in classroom situations may become anxious and uncomfortable. One reason is that 
they may need help in their learning activities but are reluctant to ask for it. The kinds of help they might 
profitably use ranges from clarification of instruction to the detailed explanation of a point, to outright help in 
solving a problem. Ho^ attentive did the teacher seem to be to the students* learning needs? 

Completely Inattentive Very Attentive to 

to Students' Needs for Students' Needs for Help 

Help in Learning Activities In Learning Activities 

1 2 3. 4 -5 6 7 . 
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4. (Instr., 47) Students may become uninterested in what goes on in the class unless their Interests and feelings are 
met. Students' interests may be accommodated by tailoring course content to specific needs or by the manner of 
presentation of more traditional content, e.g., through examples, references to everyday life. How much effort did 
the teacher put forth to accommodate students' interests and feelings? 

Made No Attempt Continually 

to Accommodate Attempted to Meet 

Students' Interests Students' Interests 
and Feelings and Feelings 

1234 567 

5. (Instr., 48) Some students are naturally enthusiastic while others need to be aroused to participate in learning 
activities. To what extent did the teacher evolve participation in learning activities intended for the class as a 
whole? 

Teacher Did Not Teacher Evoked 

Seem Able to Evoke Enthusiastic 

Any Participation Participation 

From Students From Students 



1 2 3 4 5 6 7 

6. (Instr., 49) Some teachers hold students' attention; in other classes, many students are "miles away." To what 
extent did students remain attentive to classroom activities and work steadily? 

Students Consistently Students' Attention 
Attentive and Worked Wandered, Little Time 
Steadily Spent Actually Working 

1 2 3 4 5 6 7 

7. (Instr., 50) Because the subject matter of ABE classes is so similar to elementary and secondary school, there may 
be some tendency for ABE classes to be conducted like elementary or secondary school classes. To what extent did 
the teacher treat students as adults as opposed to treating them as children or adolescents? 

Clearly Treated Students 

As if They Were in an 
Elementary or Secondary Clearly Treaied 

School Class Students as Adults 



1 2 3 4 5 6 7 

8. (Instr., 51) Overall, how formally was the class conducted? Did the teacher refer to students as Mr., Mrs., Miss? To 
what extent did the teacher act in a reserved, official manner, and expect the class to show deference? 

Teacher Conducted 

Class Quite Teacher Conducted 

Informaiiy Class Very Formally 

1 2.3 4 5 6 7 

9. (Instr., 52) When it was appropriate, how frequently did the teacher make encouraging remarks to students or act 
in some other positively reinforcing way to students? 

Never Gave At Every Opportunity, 

Positive Gave Positive 

^Reinforcement Reinforcement 

1 2 3 4 5 6 7 
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10. {Instr., 53) During the class sessions, as students recite or talk, they may give wrong answers or show that they 
misunderstand, etc. The fear of failure in ABE students tends to be great. How did the teacher handle such 
situations? To what extent did the teacher attempt to minimize a sense of failure in the students? 



Made Evaluations 
• of Student's 
Performance so as to 
heighten his 
s ense of failure 

•1 2 



Made Evaluations 
of Student's 
Performance so as to 
minimize his 
sense of failure 



n. (Instr., 54) To what extent was the physical setting o\ \he class distracting? (For example, lighting, acoustics, 
outside noise, dirt, disrepair of furniture.) 



Few or No 
Distractions 



Typical Class- 
room Distractions 



A Great Many 
Distractions 



12. (Instr., 55) Were the teacher and students tuned in on the same wave length? Did each seem to know what the 
other was talking about? To what extent did they understand each other? 



Aimost Always 
Seemed to Be 
Talking Past 
Each Other 



Deep and Complete 
Understanding 
of What Each 
Was Saying 



1 
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Co-Sponsor Data Form 



This form should be completed for each organization with which your program co-sponsors ABE classes. If, for 
example, your program co-sponsors ABE classes with ihrct' organiiialions, you should complete this form three limes, 
once for each co-sponsoring organiiiation. For some ABE programs with many co-sponsorship arrangements, it may be 
loo lime-consuming to complete this form for all co-sponsoring organiiiations. In such cases, the director may choose to 
select a sample that is representative of the whole and to complete this section only for those' co-sponsoring 
organizations included in the sample. Whenever possible, it is recommended that the director complete this section for 
each co-sponsoring organiiiation. 

The first six questions in this section require certain information about the co-sponsoring organiiiation that in many 
cases can best be obtained from records or files. If this information is not directly at hand, the director may want to 
obtain the assistance of a secretary or assistant in gathering it. 



1 . What is the name of this co-sponsoring organization? 

2. Wfial type of organization is it (e.g., hospiiai, prison, church)? 

3. How many ABE classes are currently co-sponsored with this organization? . . 

4. For how many months have you co-sponsored classes with this organization? 



5. How many students are currently enrolled in classes co-sponsored with this organization? 



6. What types of classes are co-sponsored with this organization: 

English as a Second Language 

Basic Education (native born) 

GED (H.S. Equivalency) 



7. Compared to typical ABE classes that are not co-sponsored, the class or classes co-sponsored with this 
organization: 

Less Time 



a. Required more or iess of the director's 
administrative time to establish 



b. Require more or less of the director's 
attention on a day-to-day basis 



c. Cost. more or Jess in terms 
of cost-per-student 



d. Have a more or less favorable 
retention rate 



e. Are more or less representative of 

target population program is trying to reach 

f. Enhance or detract from the program's 
visibility in the community 



g. Are easier or more difficult 
to staff 



h. Promote or detract from 

community support for ABE . .* . 



1 2 
Less Attention 

1 2 
Cost Less 

1 2 
Less Favorable 

1 2 
Less Representative 

1 2 
Detract from Visibility 

1 2 

More Difficult 
to Staff 



Detract from 
Support 



More Time 

6 7 

More Attention 

6 7 
Cost More 

6 7 

More Favorable 

6 7 
More Representative 

6 7 
E nha nee Visibility 



Less Difficult 
to Staff 



Promote 
Support 
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8. To what extent has it been necessary to modify instruction in classes co-sponsored with this organization in order 
lo meet special needs? 



Little or Great 
No Extent !^xtent 

12 3 4 5 6 7 

9. Does this co-sponsor provide services thai support classroom instruction such as child care, transportation of 
students, counseling, or special incentives for students to attend classes? 

Yes No 



10. If yes, briefly list servicet> or incentives. 



1 1. In your judgment, how important to this co-sponsor organization are the services that the ABE program provides? 

Little or No Great 
importance Importance 

12 3 4 5 6 7 
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Goal-Setting Process Form 
Complete this form for each policy decision checked in item 7 of Goal-Setting (question 75 of Director Questionnaire). 

1. With what did this policy decision deal? (Target population, recruitment, staff selection, etc.) 

2. in general, how was this issue resolved? 

3. What was your own role? 



4. Who else was involved (individuals and groups)? 

5. What was their role? 



6; What were the major influences on the resolution of the issue? 
7. What was done to encourage support for the outcome? 
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Annotated Bibliography on 
Evaluation Methods 

(Basic references arc designated by an asterisk*) 

American Institutes for Research, (1970) Evaluative Research: Strategies and Methods. Pittsburgh: AIR. (Seminar 
proceedings on aspects of program evaluation, including specification of goals, measuring outcomes, and 
evalnaiion as a process.) 

Bloom, Benjamin S., et al., (1956) Tasonomy ot Educational Objectives. Part I. The Cognitive Domain. New York: 
Lon^jmans. (Basic refeience on categories of cognitive objectives and the preparation of evak'ation items to assess 
the cxte^ to which they are achieved.) 

Bloom. Benjamin S., Hastings, |. T., and Madaus, George, (1971) Handbook of Formative and Summative Evaluation of 
Student Learning. New York: McGraw-Hill. (Emphasis on student achievement. See especially Chapter 6 on 
formative evaluation.) 

*Byrn, Darcie et al., (1959) Evaluation in Extension. U. S. Federal Extension Service, Division of Extension Research 
and Training. Topeka, Kansas: H. M. Ives. (How-to-do-it book on evaluation procedures. Oriented toward 
Cooperative Extension Service but applicable to adult basic education.) 

Cook, Desmond L., (1964) An Introduction to PERT. Columbus, Ohio: Bureau of Educational Research and Service. 
(Rationale for program evaluation in complex organizations as an adjunct to planning.) 

♦Corey, Stephen M., (\9S3) Action Research to Improve School Practices. New York: Bureau of Publications, Teachers 
College, Columbia University. (Rationale for program evaluation with emphasis on encouraging use of evaluation 
findings for program improvement.) 

Gottman, John M. and Glasen, Robert E., ( 1972) Evaluation in Education, A Practitioner's Guide. Itasca, Illinois: F. E. 
Peacock Publishers, Inc. (A guide to evaluation pioccdures.) 

Grobman, Flulda, (1968) Evaluation Activities of Curriculum Projects. AERA Monograph Series on Curriculum 
Evaluation, No. 2, Chicago: Rand McNally. (Rationale on ways to relate evaluation to curriculum development 
activities.) 

Grotelueschen, Arden D., and Cooler, Dennis D., (1972) "Evaluation in Curriculum Development," Curriculum 
Evaluation: Potentiality and Reality. Curriculum Theory Network, The Ontario Institute for Studies in 
Education. (Essay on use of evaluation for program improvement.) 

House, Ernest R., (1972) "The Conscience of Educational Evaluation/' The Teachers College Record, February. 
(Discussion of thy problems implicit in evaluation of educational programss. How educators determine the social 
worth of educational programs by non-bias evaluation.) 

Flyman, Herbert H., et al.. (1955) Application of Methods of Evaluation: Four Studies of the Encampment for 
Citizenship. Berkeley: University of California Press. (Detailed report on extensive evaluation project.) 

■ Hyman, Flerman H., and Wright, Charles R., ( 1967) "Evaluating Social Action Programs," in Paul Lazarsfeld,ei al. (Eds.), 
The Uses of Sociology. New York: Basic Books, pp. 741-783. (Rationale for evaluation of ongoing programs. 
■ Emphasis on continuity, replication, and longitudinal study.) 



Kempfer, Homer, (1955) Adult Education. New York: McGraw-Flill. (Chapter 15, on "Overall Program Evaluation," 
contains practical suggestions for program evaluation.) 



133 



Kirkpalrick, Donald L., (1967) ^'Evaluation of Training," in R. L. Craig and L. R. Bitteil (Eds.), Training and 
Development Handbook. New York; McGraw-Hill. (Rationale lor evaluation of work-related, continuing 
ed J cation progra ms. ) 

Knox, Alan B., (1969) ''Continuous Program Evaluation/' Cliapicr IS in Administration of Continuing Education. 
Washington, D. C: National Association for Public School Adult Education. (Rationale for administrative role 
regarding decisions about evaluation component of continuing education programs.) 

Knox, Alan B., (1971) Program Evaluation in Adult Basic Education. Tallahassee: Florida State University Adult 
Education Research-Information Processing Center. (Framework for evaluation based on studies). 

Krathwohl, David R., et al., (1964) A Taxonomy of Educational Objectives II. The Affective Domain, New York: 
iVIcKay. (Basic reference on categories of affective objectives and the preparation of evaluation items lo assess the 
extent to which they are achieved.) 

Los Angeles Adult Administrators, (1962) Study Guide for Self-Evaluation of Adult Schools, Los Angeles: California 
Association of Adult Education Administrators. (An evaluation guide that lists for major program components 
the purposes and procedures for evaluation, criteria for judging, and space for visiting team to list strengths, 
weaknesses.) 

*Mezirow, Jack D., Darken wald, Gordon., and Knox, Alan B., (In Press), Last Gamble on Education. (Report on 
research project that described the functions of urban ABE programs.) 

Miller, Harry L., (1964) Teaching and Learning in Adult Education. New York: Macmillan. (Basic text on learning, 
teaching, and program development in adult education. Chapter 10 on "Measuring the Effectiveness of Methods" 
provides rationale for evaluation in adult education.) 

Miller, Harry L, and McGuire, Christine, (1961) Evaluating Liberal Adult Education, (CSLEA Reports, 309). Syracuse, 
New York: Syracuse U iversity Press. (Rationale and instruments for evaluation in four topic areas in adult 
education. Can serve as exemplars for other topic areas.) 

Payne, Stanley, (1951) The Art of Asking Questions. Princeton: Princeton University Press. (Basic reference on writing 
and revising questions for interviewing and preparation of questionnaires.) 

Phi Delta Kappa Commission on Evaluation, (1970) "Educational Evaluation and Decision Mdk\x\g,'* Phi Delta Kappan. 
(Collection of viewpoints on evaluation.) 

Phi Delta Kappa National Study Committee on Evaluation, (1 971 ) Educational Evaluation and Decision Mailing. Itasca, 
Illinois: F. E. Peacock Publishers, Inc. (Based on Kappan issue.) 

Provus, Malcolm, (1971) Discrepancy Evaluation. Berkeley, California: McCutcheon Publishing Co. (Rationale for 
approach to evaluation that emphasizes identification of gaps to be closed.) 

Review of Educational Research, (1970) Educational Evaluation, (April), Vol. 40, No. 2. (Compilation of theory and 
research on educational evaluation. See especially Stake's chapter on "Objectives, Priorities, and Other Judgement 
Data," pp. 181-212.) 

Rippey, Robert M., (1972) ''Can Evaluation Be Integral to Innovation?" in Joel Weiss, (Ed.), Curriculum Evaluation 
Potentiality and Reality, Curriculum Theory Network Monograph Supplement, Ontario, Canada: Ontario 
Institute for Studies in Education. (Essay on use of evaluation results.) 

Ronan, Daniel D., (1969) "The PERT System: An Appraisal of Program Evaluation Review Technique," in Herbert C. 
Schulberg, Alan Sheldon, and Frank Baker. (Eds.), Program Evaluation in the /health Fields. New York: 
Behavioral Publications, Inc. (Review of PERT as it is used for planning and evaluation.) 
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Scriven, Michael, (1967) 'The Methodology of Evaluation,** in rtrspectives on Curriculum Evaluation, AERA 
Monograph Series on Curriculum Evaluation, No. I.Chicago: Rand-McNally, pp. 39-82. (Ralionalo for evaluation 
methods.) 

♦'Stake, Robert E., (1967) *'The Countenance of Educational Evaluation," Teachers College Record, Vol. 68, No. 7, 
April, pp. 523-40. (Rationale for program evaluation thai emphasizes systems analysis, comparison of v^hal was 
intended with what occurs, and comparisons with external standards.) 

Stufflebeam, Daniel L., (1968) 'Toward a Science of Educational EydWMxon'' Educational Technology, July 30 issue. 
(Rationale for an approach to evaluation.) 

Suchman, Edward A., (6967) Evaluation Research: Principles and Practice in Public Service and Social Action 
Programs. New York: Russell Sage Foundation. (Detailed rationale for use of evaluative research. Emphasis on 
external and summative.) 

*Tyler, Ralph W., (1950) Basic Principles of Curriculum and Instruction, Syllabus for Education 305. Chicago: 
University of Chicago Press. (Classic rationale for program development including evaluation.) 

*Tyler, Ralph W., (Ed.), (1969) Educational Evaluation: New Roles, New Means. National Society for the Study of 
Education, 68th Yearbook, Part II. (Compilation of chapters on various aspects of educational evaluation. 
Provides comprehensive overview.) 

Verner, Coolie, and Booth, Alan, (1964) Adult Education. New York: Center for Applied Research in Education, 
Chapter 6, ^'Evaluating the Activity." (Overview of evaluation of adult education.) 

*Weiss, Robert S. and Rein, Martin, (1 969). "The Evaluation of Broad-Aifti Programs: A Cautionary Case and a Moral," 
The Annals of the American Academy of Political - and Social Science: Evaluating the War on Poverty. 
Philadelphia: The American Academy of political and Social Science, Vol. 385, pp. 133-142. (Case report that 
explores problems with the evaluation of programs with general objectives.) 
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APPENDIX B 



External Standards 
Section 1: Introduction 

The purpose of this Appendix is to provide information about external standards that can be used to help interpret the 
results of an evaluation of a local ABE program. External standards provide poin ts of comparison that enable evaluators 
to better understand conclusions about the v^ay the program functions. External standards can also be used to 
determine whether the goals, aspirations, and intents of a local ABE program seem to be among the most excellent, 
worthwhile, and effective for which to strive. The standards may be relative, such as comparable descriptions of similar 
ABE progranris; or they may be absolute, such as the highest possible score on an achievement test. 

External standards can be obtained from various sources. Because they are usually prepared for other purposes, they 
tend to be scattered and hard to locate. Sources of external standards can be usefully sorted into six categories-^ABE 
evaluation reports, other evaulation reports, research reports, summaries of expert opinion, official guides, and essays. 

The remainder of this Appendix contains highlights from these various sources of external standards. These 
highlights are grouped according to the program components described in earlier sections. The highlights were selected 
as useful illustrations of external examples related to criteria that are especially important in their particular 
circumstances. 

A major source of external standards is a series of research studies on urban ABE programs conducted at Teachers 
College, Columbia University, by Mezirow and associates. Because the total series of national studies and two of the 
national questionnaire surveys are referred to repeatedly in this Appendix, the following brief titles will be used. The 
total series will be called the Teachers College ABE StudyJ * a national questionnaire survey of urban ABE directors 
will be referred to as the Administrator Survey,^ and a national questionnaire survey of urban ABE teachers will be 
called the Teacher Survey. 3 

Section 2: Recruitment 

This section contains information about outside experience and opinion that can be used to interpret local evaluation 
findings on recruitment of students. Highlights include information on the most used and most effective recruiting 
methods, the training of recruiters, the importance of making it easy for new recruits to enter an ABE program, and the 
persistence rate of new enrollees. 

An Administrator's Survey was conducted in 1971 as* part of a research study on adult basic education in the inner 
city. The survey questionnaire was completed by 100 ABE directors in cities of 100,000 population or more. Directors 
were asked about the means they used to recruit students into their programs, and how effective their methods seemed 
to be. The degree of use and perceived effectiveness were rated on seven-poir.i scales. The results, presented below, 
constitute a reference point for comparing program practice in a specific program with nationwide norms of ABE 
program practice. To make the results easier to interpret, the seven-point scale was in each case condensed' into three 
categories.^ 

Question 38: To what degree do you rely on the following means to recruit A.^JE students? 

PERCENT OF DIRECTORS 





Little or 


Moderate 


Great 


Means of Recruitment • 


no degree 


degree 


degree 








Announcements in mass media \ • 


n% 


43% 


45% 


Flyers, posters, mailings. ... ■. 


9 


45 


47 


Referrals from welfare, employment, and other agencies .... 


4 


52 


44 


Word of mouth ...... 


4 


25 


71 


Recruitment by co-sponsoring groups 


16 


50 


34 


Direct recruitment by teachers, supervisors, or counselors . . . 


10 


57 


34 


Organized recruitment by current ABE students . 


40 


40 


20 


Locdl residents used as recruitment slides 


44 


36 


20 




55 


20 


24 



♦Endnotes are located at the end of this appendix. 
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Question J9;' Based on your own experience, how would you rate the effectiveness of each of the following methods of 
recruiting ABE students? 

PERCENT OF DIRECTORS (WEIGHTED) 





Not 


Moderately 


Very 




effective 


effective 


effective 


Means of Recruitment: 








rvdiccj HI fee liven css 




* 




Announcemenis in mass media 


15% 


64% 


21% 


Flyers, posters, mailings 


18 • 


63 


\ 20 


Word of mouih 


0 


34 


66 


Recruitment by co-sponsors 


11 


57 


32 


Direct recruiimeni by teachers, supervisors, and counselors 


10 


59 


. 31 


Organised recruitment by current ABE students 


13 


56 


30 


Local residents used as aides 


31 


44 


25 


Staff member assigned to recruitment * 


28 


36 


36 



Highlights of these findings from the Administrative Survey show that word of mouth was the method-of recruitment 
which was used to the greatest degree and also was perceived as most effective. Two other means perceived-by directors 
as relatively effective were (1) recruitment by co-sponsors, and (2) direct recruitment by teachers, supervisors; or 
counselors. The assignment of a staff member to recruitment was seen as effective by a large proportion of 
administrators (36%), but almost as many (28%) believed that this means of recruitment was not effective. 

The importance of word of mouth and referrals is confirmed by other research findings. The joint Information and 
Training Services/U.S.O.E. report on "Educationally Deficient Adults"-^ states: 

Those (practices) found most'effective in the judgment of program administrators were employment service 
referrals, social agency referrals, and personal interviews. \ 

Jack Bobay, speaking at the ABE Administrators Workshop , at Northern Illinois University in 1967, stressed the 
importance of word-of-mouth recruitment when he stated: 

Probably the best recruiter we have is the teacher who does such a superior job of winning the confidence 
and respect of the students that the student wants to share this experience with his friends. Word of mouth 
publicity by satisfied students is the most effective recruiting process.^ 

The Florida State University Research Information Processing Center has drawn together research and information 
relevant to problems of recruitment faced by ABE administrators. Excerpts from their recommendations follow."* 

.... the greatest amount of recruitment activities has centered on the mass media approach . . . in the . . . 
mass media approach three elements are crucial. Is the message realistic for the desired audience? Is, the 
message portrayed in a manner which will enhance its acceptance by the desired audience? Is the Message 
getting through to the desired audience? 

For the message to be realistic, ABE must be related to the relevant life concerns, problems and interests of 
the audience . . . For the message to be acceptable requires not only that it be realistic but that it be 
conveyed in a positive manner. Who delivers the message on television and over the radio? Is it done by 
credible people— those with whom the target groups can identify? . . . For the message to reach those for 
whom it is intended, it must be delivered in a manner consistent with the viewing and listening habits of our 
target clientele. , . , 

All individuals associated with the local ABE program share responsibility for promoting the personal 
contact between the program and the potential participants. Local directors and their assistants can become 
directly involved by speaking to special interest group meetings and gatherings .. . They may become 
indirectly involved by sistting up mechanisms for personal recruitment efforts. , 
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Teachers conirihuie indirectly lu recruiiincni eflbris by providing quality learning experiences in the ABE 
programs . . . Also, teachers may encourage current ABE students to bring in potential participants to see 
the "aduli school." 



Administrators can support and encourage efforts by ABE students to form clubs -lo recruit their friends 
and neighbors into ABE classes. Teachers, too, can assist in formalizing such a mechanism by providing class 
lime and energy for these undertakings. 

■ Only one recommendation seems appropriate for the trial stage. This related to the ease with which new 
enrollees can enter into an ongoing ABE learning experience. 

The FSU research report also had this to say about the recommended characteristics and training of recruiters. 
(Recruiters, as shown by the results of the administrator's survey cited above, may be seen as either very effective or 
very ineffective.) 



1. Perceived commonality with a target group (ethnic background and community affiliation) which 
contributes to identification as "one of us." 

2. Knowledge of the available programs (objectives, curriculum, relevance and appropriateness to student 
concerns, pot ential advantages and drawbacks, and the relationship with other educational, social, and 
political endeavors). 

3. Knowledge of other community resources which might affeci the adult's decision to enroM and continue 
(transportation, child-care facilities, health clinics). 

4. Knowledge of community characteristics peculiar to the various geographical areas in which he is 
working (political structure, crime rate, sites of local clubs and their influence, etc). 

5. Ability to communicate cffecii^jcly. with the target group (listens, speaks accurately, reacts in a positive 
and constructive manner). 

6. Ability to identify with the target group (empathy). 

7. Sincere desire to assist others to develop their full potential as individuals and societal members. 

8. Commitment to the ABE program and its success. 

9. Willingness to learn more about self, about others, about the program and about the community. 

Many special demonstration projects have utilized paraprofessionals with a great deal of success. . . Other !, 
projects have utilized the total range of possibilities, e.g., teachers, teacher-aides, students, and volunteers / 
for civic, social, and political groups, VISTA, and Neighborhood Youth Corps personnel . . , Individuals 
with the most preferred characteristics should be sought no matter which alternative or combination of 
alternatives are selected. Finally, training should focus on developing those characteristics mentioned 
earlier. • - 

Dropout rate can be an indirect indicator of recruitment effectiveness as well as program efficacy. In the Teacher 
Survey,^ teachers reported the approximate proportion of their students that had dropped out after the first five weeks 



ABE: 



. Characteristics of recruiters which research has shown to be related to adults' decisions to enroll in 



of class. 



Proportion of Students 
Droppint Out 



Percent of Teachers 
Responding 



Less than 10% 
10- 24% ■ 
25 - 49% 
50% or more 



37.8% 
40.0% 
1 6.9% 

3)3% 
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The dropout rale reflects various factors, including extent of fit between student expectations and program 
functioning. Anderson^ concluded from a literature review thai many educational programs for disadvantaged adults 
provide a poor fit for the target population they purport to reach. In the evaluation of the student recruitment process, 
it would seem well to consider both the effectiveness of recruitment methods in producing enrollments, and the fit 
between those who do enroll and the ABIi program, which is partly reflected in the dropout rate. 

There are, of course, additional important aspects of the recruitment component for which no information about 
external standards has been provided. Examples include data on typical rclatonships between the number ^nd 
characteristics of . people in the target population; size of current ABE enrollment, and potential for expansion of 
enrolhncnt; data on typical extent of program visibility in target neighborhoods and posiiiveness of program image; and 
typical proportion of ABE budget and administrative time devoted to recruitment. 

Section 3: Staffing 

This pan of the Appendix on external standards contains information about outside experience and opinion related to 
staffing that can be used to interpret local evaluation findings for this program component. The highlights in this part 
include sources of ABE teachers, typical qualifications of teachers, selection criteria, teacher characteristics, teacher 
satisfaction (as reflected in opinions), and turnover. 

One staffing task is the identification of the pool from which ABE teachers will be drawn. The findings from the 
Teacher Survey showed that 80% of ABE teachers arc part-time; 20% work fulUime (20 or more ho.urs per week) in 
ABE. Of those part-Lime teachers, a significant majority held full-time jobs as elementary or secondary school teachers. 
Detailed findings were as follows:^ 

Percent of part-time Percent of full-time 

ABE teachers having ABE teachers who had 

this full-lime this as their last 

Full-time Position position. full-time position. 

EluriK-niary School Teacher (K-6) 29.0% 26.6% < 

Secondary School Teacher (7-12) 25.6 23.2 

Guidance Counselor 3-0 2.0 

School Adminisiraior or Supervisor . 5.0 3.8 

Housewife 18.5 7.4 - 

Other 19.0 36.9 



Richard Burnett, in an article on *'Basic Literacy Projects for) Adults: A Reading Specialist's Comments," commented 
on the characteristics of ABC teachers with elemcnt?*ry and secondary school teaching backgrounds: 

The impressionistic reactions were that elementary teachers seemed to be better able to teach in small steps, 
to program the learning more in small increments, to draw out their students more with a. greater pupil 
involvcmcnl in class activities, to make more use of demonstration, to be more likely to reach individuals 
rather than leach to the group, Secondary prepared teachers tended to lecture more than elementary 
teachers, to focus on larger concepts without giving heed to building small mechanical skills, and to teach to 
the group without making allowances lor individual dirfcrcnccs in readiness to learn or in the amount of 
practice required for mastery of a specific principle.*^ 

Grccnicigh Associates, in a study of four ABE learning systems, which compared the performance of different types of 
teachers (e.g., ceriiHcd teachers, B.A. generalists, high school graduates) in using the different systems, found that 

Certified teachers had most skill in dealing with learning problems, grouping students, and classroom, 
management. This did not lead to greater effectiveness as measured by student gain scores.-^ 

hi a summary of current practice in urban ABE programs, the first annual repo; t of the Teachers College ABE Study 
Slated that: 
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With few exceptions, teaching in ABE constitutes an attractive and lucrative form of moonlighting, a 
' part-lime involvement and commitment for public day school teachers v^ho are usually given priority in 
recruitment. Training in remedial reading is considered a special asset. Certification requirements limit 
hiring teachers from outside the system to those v^ith previous professional training, usually experienced 
teachers whose family responsibilities preclude full-time employment. ABE teachers may be required to 
have taught in the city for a specified period. 

There is a widespread assumption that the most relevant qualification for teaching in ABE-especially basic 
education classes as opposed to ESL— is experience teaching reading and arithmetic in the elementary 
school. 

So elementary school teachers are most frequently selected. High school teachers are more common in 
ESL classes. Some officials feel that secondary school teachers find it more difficult to relate to students in 
individualized instruction. The wide-spread assumption about the advantages of using elementary school 
teachers in ABE is tempered by a common and justifiable concern that in itself this experience is not 
sufficient. 

Previous training or experience in teaching adults in considered an important asset. There is common 
concern over the dearth of relevant graduate training for ABE teachers."^ 

What criteria arc used for hiring teachers? The Administrator Survey included an item on the importance of various 
factors in their decision to hire an ABE teacher. The distribution of responses was as follows:^ 

PERCENT OF DIRECTORS 



Factors in Decision to Hire 


Not 
Important 


Moderately 
Important 


Very 
Important 




6% 


47% 


47% 




2 


18 


80 




21 


61 


19 




8 


59 


32 


Racial or ethnic background similar 


15 


54 


31 


Personality traits judged desirable in an 


0 


9 


90 



The results of this survey show that two factors are judged to be of major importance: teacher personality traits and 
commitment to ABE goals. These factors are supported in the literature. For instance, Greenleigh Associates study 
concluded that 

. . . teachers for ABE should be selected for their warmth, interest, motivation, flexibility, understanding, 
ar J patience.^ 

Similarly, the NAPSAE report on their Survey of Adult Basic Education in New Hampshire stated: 

Though training is crucial, it is most important that ABE personnel be selected who really care about ABE 
students.^ 

How comnnitted to ABE are ABE teachers? The Teacher Survey included the following item on satisfaction with ABE: 
"All things considered, do you find teaching in ABE very satisfying, fairly satisfying, not very satisfying, or not 
satisfying?" Responses were as follows: 



Very satisfying 85.6% 

Fairly satisfying 13.3% 

Not very satisfying. 0.8% 

Not satisfying 0.2% 
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Most ABE teachers, then, appear to find their work very s^itisfying. The Teachers College ABE Study included the 
following description of ABE teachers: 



For most, motives are mixed. But the predominant reason for teaching in ABE is money. This is often a 
source of embarrassment, but is universally. recogni;ied . . . (Some) have different or more complex motives. 
Few who stay in the program fail to find rewards other than money alone. . . 

One major motive is service. Teachers see ABE as a unique chance to use their professional training as the 
cutting edge of significant social change-"where the action is" . .. Service motivated teachers include 
those who "want to be more than a teacher" lo students. . . 

For whatever combination of these factors, most teachers are highly motivated and dedicated to teaching in 
ABE. There is a widespread realization that "you've got to sell yourself" to the students, and they try 
hard. . . ^ 

Who are ABE teachers, anyway? According to the Teachers College ABE Study, "The average ABE teacher is white, in 
his late twenties or thirties, and teaches elementary school classes during the day."^ ^ The Teacher Survey included 
items on age and ethnicity. Th-j responses are given below: ' ' 





Percent of 


Age 


ABE teachers 


Under 30 


27.0% 


30-39 


27.9 


40-49 


22.9 


50-59 


16.4 


60 or older 


. -5.9 




Percent of 


Ethnicity 


ABE teachers 


Puerto RIcan-Amcrican 


0.4% 


Mexican-American . .'. . 


5.7 


Black ■. 


28.8 


White 


63.9 


Other 


1.3 



Regarding the use of minority group teachers, the Teachers College ABE Study noted that: 

. . . Administrators are clearly aware of the advantages of recruiting minority group teachers. . . Recruiting 
difficulties stem from the small numbers of college-trained minority group teachers in most public school 
systems. . ^ 

Regarding the lack of college-trained minority group members, there was a related finding in the Greenleigh study. 
They found that high school graduate ABE teachers were effective; and they state; that "Persons who are high school 
graduates should be considered an important resource and should be recruited. . ."' ^ 

Ethnicity of teachers (and other staff rnembers) can be important. Systems Development Corporation, in a study of Job 
Related ABE, made the following recommendation: 

In general, as many staff members as possible should be direct or indirect representatives of the program's 
target population, to assist student motivation and communication, and to provide inputs to program 
evaluation and improvement. 

Paying particular attention lo the language aspect of ethnicity, Greenleigh Associates made this recommendation: 
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... Where feasible, multilingual teachers should be assigned to adult classes of students who have liilleor 
no proficiency with the English language or bilingual students assigned to permit a "buddy system."^ ^ 

Whatever the importance of such* characteristics as linguistic ability, ethnic background, training,. -ind so forth, the 
crucial atiribntes of the effective .ABII teacher appear to be related to personality. The importijnco of teacher attitude is 
summed up in this statement: 

Perhaps the most important contribution of these teachers v^as found in the attitude they brought to their 
work. They emphasized success and steady progress and made it clear that they expected every man to 
learn effectively and rapidly. This attitude spread to the students, who came to recognize and appreciate 
their ability to learn. Thus, the cycle began and continued; success brought confidence, and confidence 
brought further success.'^ 

The data on teacher turnover from the Administrator Survey provide these indications of national experience: 

Percent of 

Rate of Turnover * Directors Responding 

. Heavy (25% or more) .9% 

1 Moderate {2A-] 1%) 27% 

I Li.uhi (IO%oriess) 65% 

I 

There are, of course, additional important aspects of the staffing component for which no information about external 
standarris has been provided. Examples include the roles of persons engaged in the staffing process, the extent of 
formality of the staffing process, typical arrangements for placement of new staff, and staffing procedures for persons 
other than teachers> ^ 

Section 4: In-Service Education 

This part of the Appendix on external standards contains information about outside experience and opinfon related to 
in-service education of staff thai can be used to inlcrprel local evaluation findings for ihis program, component. The 
highlights of this part include criteria for staff development; typical methods of in-service education, sponsors of in- 
service education, content of in-service education, proportion of staff who participate, and perceptions of ddminisiralors 
and teachers regarding adequacy of in-service education for teachers* 

The need for in-service education for ABE teachers is generally recognii^ed. In listing the criteria for evaluation of ABE 
programs in North Carolina, the following criteria related to staff development and in-service education were 
included: 

(1) Allocation of supervisory time to instructional improvement in the ABE program is commensurate with 
the size of the teaching staff and clientele. » 

(2) Personal records of supervisory activities are kept on file reflecting consistent efforts to improve ABE 
instruction. 

(3) There is evidence of frequent and open communication regarding the supervisor-teacher relationship. 

(4) Locally sponsored opportunities are provided for in-service training for ABE personnel.^ , 

Here emphasis is on the importance of the supervisor, as well as the existence of locally sponsored and conducted 
in-service education programs in increasing the competence of instructional staff. 

The administrators who responded to the Administrator Survey described current practice with regard to in-service 
education in ABE when they responded to the following:- 
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(I) Arc ABl. leachersm/i//m/ to lake prc-scrvicc or in-sorvicc training of any kind? 



78% Yes 2}%_ No 

(2) If Yes, which of the following options will satisfy the rcqLtiremont? (check all thai apply) 

Singlii conl'iiriincc or workshop 28% 

Two cr more conioriiMCiis or workshops 53% 

Courscwork In aduh liducation 19% 

Olhcr H% 

(3) Approximately what proportion of the total ABE teaching staff has had pre-service or in-service training 
in ABE? 

% of Teaching 

Staff 0 10 20 30 40 50 60 70 80 90 100 



% Directors 
Responding 



3% 1 % 3% 2% 3% . 3% 7% 1 1 % 64% 



Four-fifths of all ABE programs require pre service and/or in-service training for ABE teachers. Only 1 0% of directors 
report that less than half of their Instructional staff had participated in such training. Almost two-thirds of the directors 
reported 90% or more of their staff had participated. Conferences or workshops appear to be the most common form 
of in-service education, and most programs required in-service education attendance at two or more. 



;,How satisfied are ABE teachers with the in-service education provided? Asked to agree or disagree with the statement, 
'The ABE administration does not provide adequate in-service education experiences,"^ the response was as follows: 

Strongly Strongly 
Disagree Agree 

12 3' 4 5 * 

34.7% 18.6% 22.1% 19.7% 12.3% 

Almost one-third felt that available in-service education activities were inadequate to some degree. Just over one-third 
felt strongly that it was adequate, and an additional fifth felt almost as strongly that this was the case. However, what 
teachers perceive as "adequate" may not in fact be adequate for an excellent program. 

While the foregoing questionnaire responses were focused on teachers, other categories of staff should also be included 
in ABE in-service education. Alan B. Knox, writing for the FSU Research to Practice series, stated: 

The undereducated adults who are the participants In ABE programs require an effective instructional staff 
if they are to persist and learn. Assistance is provided by several categories of instructional staff, including 
teachers, paraprofessionals, counselors, writers, and supervisors. Because they all perform the mentor role in 
interdependent ways, they should all be included In the programs of in-service education.^ 

Knox went on to discuss the relative virtues of in-service education conuucted by the local program or by other 
agencies. 

ABE staff do and should participate in continuing education programs such as teacher training institutes 
conducted by universitites or professional associations. Such external programs have many advantages, such 
as accessibility of resource persons ahd exchange of new Ideas. However . . . in-service education conducted 
by the unit of the school system or other institution that sponsors the ABE program (is an) organizational 
setting for continuing education (which) has unique potential for the translation of mentor understanding 
into iraproved practices. The result is greater achievement by ABE participants.^ 
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Richard Burnett, in the article on Basic Literacy Projects for Adults cited earlier, said the follov.'ing about the ABE 
teacher's need for in-service education: 

It seems that not only does the volunteer v^ho is not a trained teacher need training in the rudiments of 
teaching reading, but that the professional teacher as v^ell is likely to need such training before v^orking 
with illiterate adults.^ 

Burnett spotlights one area for in-service education which he feels is of great importance: 

Clearly . . . teachers in a literacy project should be oriented to the sociological background of the students 
they are to teach. A realistic understanding on the part of the teachers of the living conditions of the 
enrollees, their educational and experiential backgrounds, their opportunities for. recreation, and their 
aspirations for themselves and for their families will go a long way toward insuring an instructional program 
geared to meeting the real needs of adult illiterates.-^ 

Of the teachers who-.,responded to the Teacher Survey, approximately 80% had had pre-service or in-service training. 
Asked to indicate the specific type of training and degree of helpfulness of each, they responded as follows:^ 





Percent who 
participated 
in this type 
of training 


Little or 
No Help 


PERCENT RECEIVING THIS 
DEGREE OF HELP 

Some 
Help 


Great 
Help 


Local pre- or in- 


, . . ■ 68.4% 


10.0% 


47.8% 


42.2% 


Obscrvaiion of 


33.5 


10.4 


43.3 


46.3 


Courscwork in aduli 


29.1 


8.7 . 


39.0 


52.3 


Regional summer 


24.9- 


9.4 


35.5 


55.1 



The aim of the in-service education program should be to have as much impact as possible on actual performance in the 
classroom, as this is where the ultimate outcome— improved student achievement— must be sought. In a working paper 
prepared for its regional workshops, the Teachers College ABE in the Inner City Project dealt with how to do this most * 
effectively 

Teacher performance will be most enhanced by training which focuses upon analysis of actual classroom 
performance with opportunity fnr practice and feedback in specific skill areas identified . . . ABE teachers 
need guided practice in personalizing abstract ideas, using learning groups, discussion and other methods of 
adult education to evoke student involvement. How to involve and motivate in the first and early meetings, 
ask questions, teach "coping" skills (including those involved in learning), prepare instructional materials 
and innovate in various instructional approaches are training priorities. Videotapes of ABE classroom 
instruction can be invaluable for teachers to learn to analyze commonalities and variations in the 
organization of instruction, of methods of mediating content with learner experience, patterns of social 
interaction, and the mechanisms of failure management and control. ''Understanding the student 
popuiaiion" should consist less of generalized insights about the culture of poverty from the literature and 
' more of inquiry arising out of observed classroom behavior.^ 

There are of course additional important aspects of the component on in-servicn education of staff for which no 
information about external standards has been provided. Examples include: the typical proportion of the ABE budget 
and administrative time devoted to in-service education; administrative expectations of the results of staff development 
efforts; the history of prior staff participation in in-service education; arrangements for released time or extra pay for 
participation in in-service education; typical procedures for planning in-service education; evidence of resultant 
improvements of staff performance; and evidence of improved staff morale. 
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Section 5: Instruction 



This pan of the Appendix on c.xiernal standards contains informaiion about outside experience and opinion related to 
instruction usclul for interpreting locnl evaluation findings for this program component, riic highlights in this part 
include criteria of exccMeni instruction, typical emphasis on various instructional methods, relative emphasis on 
content, typical sources of instructional niaterials, and use of evaluation procedures such as diagnostic and achievement 
tests. 

Because the teaching-learning transaction is the core of the ABE program, there are more references in the literature 
I elated to instruction than io the other program components. Some references deal v^ith the total ABE program, but 
focus on teaching, such as the monograph by Ulmer. ^ Other books, such as the ones by Ulmer and Dinnan,^ and by 
Mangano,^ focus more specifically on teaching of reading. Each of these contains many guidelines and 
recommendations that local evaiuators can use to compare v^ith their ov^n evaluation results. Some reports based on 
research, such as the ones by Laffey,"* and by Kreitlow,^ contain generalizations that are useful to interpret local 
evaluation findings. With an increasing number of learning centers associated v^ith ABE programs, a set of guidelines, 
such as the ones provided by Sherk and Mocker,^ provide a source of external comparison. 

In the instruction component, standards and norms of practice in the field may be general (e.g., curriculum 
organization, lesson planning) or more specific (e.g., characteristics of adult learner activity, adult classroom 
interaction). 

A representative example of what might be called "general standards" is included among the criteria used for evaluating 
programs in North Carolina in 1971. The instructional criteria included: 

()5) There is evidence of some systematic plan for sequencing subject matter in the ABE 
classroom/learning lab. 

( 1 7) There is available some document which sets forth and/or describes the local ABE curriculum and 
serves to guide and coordinate the total instructional effort. 

(18) The local ABE curriculum consists of offerings which are congruent with the backgrounds and needs 
of the clientele served. 

(19) The methodology and techniques employed in the learning situation are appropriate and consistent 
with the principles of adult learning. . 

(26) Definite performance goals and standards have been established to guide the evaluation of students and 
provide direction for subsequent learning experiences. 

(33) Teachers have specific objectives outlined for each class meeting and have planned appropriate learning 
t . experiences to accomplish such objectives. 

(35) Instruction is characterized by its emphasis on the short-term goals with some specific learning 
objective(s) being realized during a given class meeting. • 

(37) Instructional methodology and techniques employed are commensurate with the nature of the stated 
objectives^ <^ 

A major concern in ABE instruction is that ABE participants be treated as adults. Systems Development Corporation, 
in its study of Job Related ABE, stated in one of its recommendations: 

Instructional procedures, materials, equipment, etc. should be oriented to the particular adults to be 
instructed. The total program should be immediately meaningful to those adults, should be as enjoyable as 
possible, and should not resemble a program for children.^ 
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The report went on to make this specific recommendation: 



The learner should be given as much responsibility as he can handle for his own learning goals, methods, 
evaluation, rales of progress and materials.^ 

Margaret Carroll suggested the follov^ing "teaching principles" which should be followed in ABE classrooms in a talk 
to ABE administrators: 

(1) The teacher listens, observes, suggests, evaluates, records, and gives approval as the student, (a) 
self-selects; (b) self-directs; (c) self-evaluates; (d) self-reports his own education opportunity, and (e) 
plans ahead for his own growth. 

(2) The question which the teacher uses in approving the student's selection of the educational situation is: 
"Will this permit the student to progress in content, process, or mode of inquiry, and values?" 

(3) The teacher trusts the students. ' ^ 

The foregoing suggestions are concerned with the adult ABE participant as an autonomous, self-directing adult. They 
tend to deemphasi/.e the traditional classroom student-teacher relationship in which the student sits in the seat and 
listens to the teacher lecture to the class as a whole, and put more stress on the student's ability to learn 
independently. This may be done individually, or in a group. ABE administrators, in the Administrator Survey, 
responded to a question regarding relative emphasis on various teaching techniques:^ ^ 

PERCENT OF DiRECTORS ' 

Little or Some Great 

Instructional Technique No Emphasis Emphasis Emphasis 

Instruction geared to entire 

class 33% 52% 15% 

Instruction geared to small 
groups working at similar tasks 

pr at similar grade levels 2 46 52 

Instruction seared to 

individuals working alone 6 30 64 

Over half of the administrators reported giving "great emphasis" to instruction geared to small groups. Why is this 
desirable, and how should it be carried out? A study of job related ABE that was cited earlier had the roilowing to say 
about groupi.ng students:. 

• Students should be grouped for effective mutual assistance and for social reinforcement of individual 
motivations. When possible, learning groups should contain students with similar backgrounds and goals but 
with somewhat diverse achievement levels. It is desirable for each group to include both newer and older 
students. Newer students should be assisted by the older students, to their mutual benefit and 
encouragement.^ ^ 

This may be ideal, but what often happens, as shown in a report of research on ABE programs in the Chicago area, is: 

... most teachers find themselves having to group on the basis of areas of difficulty within the class: 
Unfortunately, this grouping seems to be done rather haphazardly and solidifies into three (or two, or four) 
fairly inflexible groups . . . One teacher said that he groups for different purposes: cursive writing, sight 
vocabularly, speaking vocabulary, and arithmetic skills. These groups are fluid in nature.^ ^ 

A survey of ABE programs conducted iointly.by U.S.O.E. and Information and Training Services reported that: 

All programs surveyed exhibited a combination of group and individual methods of instruction. Group 
methods used were ranked by frequency of use in this order: (1) group discussion; (2) demonstration; (3) 
commercial TV; (4) team teaching; (5) open circuit TV; and (6) miscellaneous talks by outsiders. 
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Inilividual niulhocls ol insiruciion favored (1) luiorial; (2) self-study; (3) programmed instruction; 
(4) student; and (5) assigned homework J"^ 

The combined use of groups and individual v^ork may be characteristic of adult education in gcncrah There are other- 
desirable emphases in working with undereducaled adults who have previously experienced failure in the classroom. 
Effective failure-management is an important skill for the ABE instructor. Systems Development Corporation makes this 
recommendation: 

Positive reinforcement methodologies should be used. Each student's progress toward his own and program 
goals should be acknowledged, but invidious comparisons with the progress of others should be avoided.^ ^ 

Greenleigh Associates reported the following finding on ABE teachers (compare this with the statement ai the end of 
the staffing section on the importance of teacher attitudes): 

Some of the teachers make a deliberate effort from the first session to impress upon their students a 
confidence that "it can be done." Most of the teachers stated that they make every attempt to prevent an 
individual from farming at any given task. One teacher said that he assumes the student "has forgotten if he 
can't do it." In most classrooms each student is allowed to progress at his own rate of speed. All the 
teachers stated that they are very liberal with praise for progress, and many ^ noted and said that they 
encourage praise from members of the group when an individual shows progress.^ ^ 

Whai content areas should be stressed in ABE? A cross section of urban ABE administrators who replied to the 
Administrator Survey responded to this question: "How much emphasis does your ABE program place on each of the 
foflowing content areas or skills?" Their responses reflect current program practice.' ^ 

PERCENT OF DIRECTORS 



Content Areas 


Little or 
No Emphasis 


Some 
Emphasis 


Great 
Emphasis 




0% 


6% 


94% 






30 


69 




^ i5 


74 


10.. 




5 


67 


27 




5 


68 


28 




27 


64 


9 


Coping skills (e.g., how to 
complete a job application, 
lake a lesi, deal with 


n 


50 


39 



The heavy emphasis on language skills and arithmetic is to be expected, yet other aspects of the program are also 
important. NAPSAE, in its study of ABE in New Hampshire, included this among its criteria for effective ABE 
instructional programs: 

ABE classes should be student-centered and should include practical information like filling out application 
forms. Every effort should be made to find out Wnat Vuc students want.^ ^ 

A specific area which gets only some emphasis in current practice was pinpointed as crucial in a study of ABE in 
Appalachia: 

Program content concerning abuses of installment buying is important to ABE curricula, since many 
individuals are rendered aln^ost permanently unemployed because of a history of garnishees.' ^ 

The problem of ABE instructional content and ABE instructional materials is closely linked. Arno Jewett, member of a 
U.S.O.E. task force on ABE, reported that: 
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By iind large, in the classes I visited, the interest was not in mathematical studies per sc nor in arithmetic, 
but only: "How much of this can I learn in a hurry ns a stepping stone to a job?" With this in mind, 
teachers arc looking for sources of materia). . . 

(1) The materials the teachers told me they would like most to have would be some kind of loose-leaf 
pamphlet material. T'le reason for this is that if they see that Mr. Jones does not understand carrying 
multiplication, they can backtrack to the looseleaf material and pull out those lessons for review. 

(2) The teachers indicated that, for motivational purposes, they would like to have work problems 
separated from mechanical drill work. They would also like to have a variety of work problems 
concerned with different vocalions.^^ 

Because ABE instruction should be geared to the specific learning needs of ABE participants, which will vary according 
to student skill levels, learning style, geographic location, employment status, family characteristics, and so on, there is 
a generally recognized need to prepare materials that are relevant to particular students in particular classes. The 
Admini!>trator Survey asked administrators about the use of commercially prepared and locally prepared materials. The 
responses were as follows:^ ' 

(1) Approximately what proportion of' materials used for ABE instruction in your program are obtained 
from 'commercial publishers? 

% Directors 

Responding 1% 2% . 7% 45% 44% 

% of Materials 

Commercially 0-20% 21-40% 41-60% 61-80% 8M00% 
Prepared 

(2) Approximately what proportion of materials used for ABE instruction in your program have been 
developed, so far, by teachers or other ABE staff? 

% DIreclors 

Responding 64% 23% 5% 2%_ 2% 

% of Materials 

Developed by 0-20% 21 -40% 41 -60% 61 -80% 81 -1 00% 
ABE Staff 

Regarding the relative effectiveness of commercially prepared and locally prepared materials, a 1964 survey of ABE 
programs by U.S.O.E. reported that: 

Internally prepared materials were generally considered more effective because they were more closely 
adapted to adult needs.^^ 

An important issue that arises in ABE is the way in which student achievement is evaluated, both for purposes of initial 
placement in a suitable class, and for evaluation of student progress in the class. Reflecting a common point of view, the 
report of an ABE piiot project conducted in Austin stated that: 

_ A battery of tests given immediately upon enrollment tends to discourage or even prevent the potential 

ABE student from attending classes. We recommend a brief placement instrument, then, when the teacher 
has- had an opportunity to establish a rapport with the student, further testing may be done if deemed 
necessary. 2 3 

Not only do students react adversely to tests, but 

. . . Certainly, neither standardized reading nor intelligence tests can be considered "culture-free." Most 
teachers feel that the ievei of capacity of each pupil becomes obvious as instruction progresses. 

■ — <» 
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Many juihoi ilics recommend lhal each suideni be given an initial informal reading inventory. 



Burnett warned that test scores can be deceptive: 

The literacy teacher learns quickly, if he is perceptive, that two adults may score at a fifth grade equivalent 
. on a public school standardized test but that one may be willing and able to read a daily newspaper with a 
reasonable degree of understanding while the other may be completely incapable of even at templing to read 
the paper. Experience such as this causes the literacy teacher to go beyond standardized test scores and 
attempt to find through informal measures exactly what rhaterials an adult can read at the beginning of a 
training program.-^ 

Earlier ir, this section reference was made to the ABE participant as an adult learner. Most teachers in ABE come from a 
background of teaching children. In their ABE classroom, they must develop relationships with their students which arc 
appropriate to the participants* adult status. Following the»r survey of Chicago ABE, Hayes, et a/., reported extensively 
and insightfully on teacher-studeni relations: 

In response lo a question on teacher-pupil relationships, over half the teachers answered that they try to 
maintain a person-to-person or ndult-to-adult relationship. A few stated they did maintain a teacher-student 
relationship; and the remaining teachers said they found themselves shifting from position to position in 
response lo certain individuals and situations. One teacher pointed out that his younger students ''were not 
as businesslike if 1 am friendly.** 

In response lo the question, "Do you get involved in the personal lives of your pupils?" slightly over half 
the teachers interviewed replied yes, though a few maintained they would rather not but seemed to have no 
choice. Interestingly enough, half the respondents answering that they maintained a teacher-pupil 
relationship also answered that they did not get involved in their personal lives and did much counseling. 
This set of responses leads the investigators to suspect a kind of paternalism in the classroom which may 
need reconsideration because of the possible poor effects of such an attitude on the independence and 
self-respect of the adult participants. 

In response to the question, "Do you find yourself counseling?" again slightly over half also answered yes.- 
Some of * the teachers who answered positively were somewhat apologetic about this role; others accepted 
counseling as part of their function and actively prepared themselves to be useful in this role. 

;f; + -t ' 

One thorny problem of teacher-student relationship that most teachers feel unqualified to solve is the 
problem of how to address their students. Most teachers start on a Mr., Miss, or Mrs. basis with their pupils, 
but when and if a first name basis should be reached remains unanswered. The investigators would speculate 
that the positive effect on the students* self-concept of the continued formal mode of address might 
outweigh the advantages of the more casual mode of address. The usual adult nonliterate evidences a 
terrible need for respect. 

There are, of course, additional important aspects of the instruction component for which no information about 
external standards has been provided. Examples include evidence of benefits to students, such as academic 
achievement, pursuit of further occupational development, and various forms of daily coping. Some aspects are 
included in other components, such as characteristics of students in Section 2 on Recruitment, and Characteristics of 
teachers in Section 3 on Staffing. As evaluation materials are developed for additional program components that are not 
covered in detail in this manual, information will be included on aspects such as counseling and facilities. 
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Section 6: Coliaboration 

This part of rhc Appendix on external standards contains information about outside experience and opinion related to 
collaboration with co-sponsors and referral agencies that can be used to interpret local evaluation findings for this 
program component. The highlights in this part include aims of collaboration, types of co-sponsors, and use of liaison 
personnel. r 

There are three basic aims of collaboration supported In the literature. One involves "united community effort"~'this is 
the aspect of collaboration which is most important in terms of the public image of the ABE program, the community 
support which it enjoys, and cooperation rather than competition among groups offering services to disadvantaged 
adults. For example, the report on evaluation of North Carolina ABE included the; following criteria to judge the 
programs: 

(5) There is evidence of working relationships with appropriate agencies in order to effect wider community 
effort in meeting the needs of the undereducated adult. 

(7) An advisory body has been established to provide assistance and direction to the overall ABE effort.' 

A second aim for collaboration is the provision of services needed by ABE participants which would not normally be 
provided by the ABE program itself. The U.S.O.E. report on the educationally deficient adult stated: 

Supporting services, such as transportation, recreation and social activities, nursery care of trainees' 
children, food services, correction of impediments to learning, such as defective sight and bearing, are a few 
of the auxiliary services which will need to be provided for in the training system.^ 

Burnett expanded on this: 

It appears that the per cent of adults in literacy programs in the United States who are illiterate just because 
. of an educational deficiency, uncomplicated by physical as well as emotional, intellectual, and sociological 
factors, may be quite small. It seems logical to conclude that adult literacy projects utilizing untrained 
teachers and functioning without adequate provisions for medical referral, vision and hearing corr'^ction, 
aiiu ijtjycnulugical services are going to make only a minimal contribution to alleviating the adult literacy 
problem in this country.-^ 

A third concern relevant to collaboration which appears in the literature involves making the ABE program actually and 
visibly useful to the participant. As stated in the System Development Corporation study of Job-Related ABE: 

ABE programs with employment goals must be actually and visibly linked to student futures which extend 
through as many employment-trainlng-educational stages as necessary. . . 

Employers must participate in job-related ABE programs at least to the extent of making initial placement 
or job advancement possible for program graduates. This would include participation in job analysis and job 
performance evaluation as needed for program development and improvement."^ 

I he Administrator Survey included items about collaboration. One hundred directors responded. The questions dealt 
with co-sponsorship, referrals, and the use of community liaison personnel. . 

With regards to co-sponsorship, the directors responded to the following questions:^ 

17. About how many classes does your ABE program co-sponsor with each of the following organizations 
or agencies? 
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Number of Directors who Reported Various 
Numbers of Classes with each Type of Co-sponsor 

Categories of Number of Classes 



Types of Co-Sponsors 


U 


1 '5 




I'V 




59 


24 


9 


8 




63 


30 


5 


2 




53 


24 


1 1 


7 




54 


30 


)0 


6 


Non-CAP Community Organizations . . . . 


59 


19 


14 


1 1 




56 


34 


4 


6 



For each type of co-sponsor listed, between 50 and 60 percent of the ABE programs had no co-sponsor links. However, . 
almost a fifth of the directors reported co-sponsorship with churches, businesses, and CAP agencies, and a fourth 
reported co-sponsorship with non-CAP community organizations. In response to another question, half of the directors 
reported that co- sponsorship of ABE with business, hospitals, and other organizations to upgrade employee skills was a 
standard practice in their program. Another quarter or more said that they had just initiated this practice; only 18 of 
the 94 directors who responded to this item stated that they had never done so.^ 

ABE directors also responded to a question aboi?l their use of referral linkages with other agencies:^ 

(20) With which of the following agencies does your ABE program make or receive referrals of participants? 

Percent of Directors Who 

Agency Responded Affirmatively 

Welfare 96% ' . 

Employment ^5 

Manpower training 65 

. CAP agencies 69 

Non-CAP community organizations 61 

Other.... 36 

Almost all directors reported that they received and made referrals with welfare and employment agencies. Manpower 
training, CAP agencies, and other community organizations were linked to almost two-thirds of the ABE programs in 
referral relationships. 

What about the use of liaison personnel by the ABE program, to promote cooperation rather than competition among 
organizations that serve the undereducated adult and to develop increased community support for the ABE program? 
ABE directors indicated the extent to which they used such personnel:^ 



Employment of community relations 
personnel as liaison between ABE 
and the community 



Number of Directors • 
Who Responded 

56 Never Did So 

5 Formerly Did but 
Have Stopped 

20 A Standard Practice 

13 Recently Started 



There are, of. course, additional important aspects of the collaboration component for which no information about 
external standards has been provided. Examples include the typical proportion of the ABE budget and administrative 
tjme devoted to collaboration, and typical outcomes of collaboration in the foim of cost reduction, increased 
enrollments, reaching harder-to-reach adults, and increased community support. 
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Section 7: Goal-Setting 



This part of the Appendix on external standards contains information about outside experience and opinion related to 
the goal-setting process that can be used to interpret local evaluation findings for this program component. The* 
highlights of this part include sources of influence on the goal-setting process, and relative emphasis on various goals 
and content areas. 

The Administrator Survey included an /rem on factors that influence ABE instructional goals. These included the State 
ABE plan, as well as persons and groups t iat influence the goal-setting process. Results vvere:^ 

NUMBERS OF DIRECTORS WHO SELECTED EACH 
EXTENTOF INFLUENCE 

.'" Liiile or Moderate Great 

5 No Influence Influence Influence 



Yourself 3 38 59 

Slate ABE Plan 6 53 41 

Teachers 3 27 68 

Supervisory Staff 7 40 33 

State ABE Staff 9 59 28 

ABE Students 3 41 55 

Counselors 9 50 27 



The ABE director himself, the teachers, the students, and the supervisory staff were seen as having a Great Influence by 
one-half to two-thirds of the ABE directors. 

Which. instructional areas arc in fact emphasized? The ABE administrators in the Administrator Survey responded to 
the question: "How much emphasis does your ABE program place on each of the following content areas or skills?" 
The distribution of their responses provides a picture of current program practice:^ 

PERCENT OF DIRECTORS 



Content Areas 


Little or 
No Emphasis 


Moderate 
Emphasis 


Great 
Emphasis 


Reading, language skills 


- 0% 


6% 


94% 




0 


30 


69 


Health oducalion 


15 


74 


10 




5 


67 


27 




5 


68 


28 


Ethnic or racial heritage 


27 


64 


9 


Coping skills (e.g., how to 
complete job applications, 
take a lest, deal with 


1 1 


50 


39 



In the Teacher Survey, teachers responded to the same question as follows (condensed 5 point scale): 

PERCENT OF TEACHERS 



Content Areas 


Little or 
No Efnphasis 


Moderate 
Emphasis 


Great 
Emphasis 


Reading, language skills 


4% 


A% 


92% 




28 • 


13 


60 




57 


25 


18 


Consumer education 


38 


31 ^ 


31 




34 


35* 


31 




56 


24 


18 


Coping (how to apply for a 
job, obtain legal assistance, 
deal with landlords) 


32 


27 


41 
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Teachers appeared U) place less emphasis on arithmetic than did adminiiiiraiors. Although approximaicly the same 
proportion of teachers as administrators reported "great" emphasis on health education, consumer education, social 
studies, and coping skills, many other teachers assigned little or no emphasis to these subjects. 

What goals do. teachers believe to be most important for ABE? Asked tu rank in order the following five goals, teachers 
responded as follows:*^ . 



PERCENT OF TEACHERS WHO ASSIGNED EACH RANK 



Goal 


1 (high) 


2 


3 


4 


5 (low) 


Total 




■33% 


37% 


19% 


9% 


3% 


100% 




5 


9 


14 


48 


24 


100 




20 


20 


36 


16 


8 


100 


Preparalion for high school equivalency 


16 


9 


12 


16 


48 


100 


Increased ability lo cope wiih aduli 
















32 


27 


20 


10 


II 


100 



Seventy percent of the teachers ranked increased self-confidence as one of the most important goals, and 60% 
ranked increas.^d ability to cope with adult life roles and problems as first or second in importance. In contrast, 
completion of cei tification requirements ranked low in priority (8th grade equivalency~72% ranked 4 or 5; high school 
equivalency-64% ranked 4 or 5). Forty percent of the teachers felt that "increased language skills" was one of the two 
nx>si important goals. 

What goals do administrators have for their programs? The Administrator Survey included an item on factors that were 
important to them in evaluating ihc success of their program. The directors responded as follows:^ 

PERCENT OF ADMINISTRATORS WHO RATED f ACTORS AT 
EiACH LEVEL 





Little or 
No Importance 


Moderate 
Importance 


Great 
Importance 




6% 


49% 


44% 




5 


-'40 


54 




3 


38 


58 


Number of students placed in jobs 


13 


56 


31 


Learning gains measured by standardized 


9 


53 


38 


Success In recruiting "hardcore" chronically 


7 


40 


52 



While all of these criteria were seen as important by most directors, three stand out as of particular importance. Over 
half of the directors rated the following factors as of great importance: dropout rate,_number of students completing 
eighth grade, and success in recruiting "hardcore" chronically unemployed persons. Number of students placed in jobs 
or job training programs was viewed as the least important of the five criteria. 

There are, of course^ additional tmportanl aspects of the goal-setting component for which no information about 
external standards has been provided. Examples include typical working relationships between the ABE unit and the 
remainder of the school system, the director's perception of his role in the goal-setting process, and the ways in which 
written statements of goals are used. 



153 



Section 8: End Notes 



Part I: Introduction 

1. The first annual repori is eniil'.ocl Analysis and Interpretation of ABE (experience in the Inner City: Toward a 
Theory of Practice in the Public Schools. New York: Center for Aduli Educaiion, Teachers College, Cokimbia 
University; 1970. The final lepoi i is cniiiled Last Gamble on Education (in press) by Mczirow, Darkenwald and 
Knox.. 

2. The adniinisiralor survey qucslionnairc is tilled ''Study of Urban Public School Adult Basic Education." 
' 3. The teacher survey questionnaire is titled "National Survey of Adult Basic Education Teachers." 

Part 2: Recruitment 

1 . Study of Urlxin Public School Adult Basic Education. (ABE in the Inner City Project.) New York: Center for Adult 
Educaiion, Teachers College, Columbia University. 1971. 

2. Information and Training Services and U. S. Office of Education. Educationally Deficient Adults, 1964. Abridged 
report included in Lanning. Frank W., and Wesley A. Many, (Ed<>.). Basic Educatiai for the Disadvantaged Adult: 
Theory atid Practice. Boston: Houghton Mifflin Company, pp. 396-7. 1966. 

3. Gs)cring, Oswald H., and Michael ). Stotts, (Eds.). Perspectives in Adult Basic Education for Adininistrators. 
Proceedings of the ABE Administrators* Workshop at Northern Illinois University, in cooperation with NUEA. 
DcKalb, Illinois: Northern Illinois University, 1967. Citation from Jack Bobay, "Publicity and Promotion of ABE 
Programs," p. 90. 

4. Snyder, Robert E. Recruftinent in Adult Basic Education. Tallahassee, I'lorida: Research information Processing 
Center, Department of Adult Education, Florida State University. 1971. 

S.iVational Survey of Adult Basic Education Teachers. (ABE in the Inner City Project.) New York: Center for Adult 
Education, Teachers College, Columbia University, p. 7. 1971.- 

6. Anderson, Darrell V. Analytical Review of Remedial Educational Programs for Socially and Economically 
Disadvantaged Adults. Vancouver: University of British Columbia. M. A. Thesis. 193 pages. April, 1968. 

Part 3: Staffing 

\. National Survey of Adult BasL: Education Teachei^s. (ABE in the Inner City Project.) New York: Center for Adult 
Education, Teachers College, Columbia University, p. I. 1971. ■ 

2. Burnett, Richard W. "Basic Literacy Projects for Adults: A Reading Specialist's Comments," in Lanning, Frank W., 
and Wesley A. Many, (Eds.). Basic Education for the Disadvantaged Adult. Boston: Houghton Mifflin, p. 240. 1966. 

3. Greenleigh Associates. Field Test and Evaluation of Selected Adult Basic Education Systems. New York: Grecnieigh 
Associates, Inc. p. 15. September, 1966. 

A. Analysis and Interpretation of ABE Experience in the Inner City: Toward q Theoiy of Practice in the Public 
Schools. (ABE in the inner City Project.) New York: Center for Adult Educaiion, Teachers College, Columbia 
University, p. V-1, 2. 1970. 

S. Study of Urban. ^ . ABE, o\). c\\.,p.^. 

6. Greenleigh Associates, op. cit., p. 17. 
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7, NAPSAE, Survey of Adult Basic Education in New Hampshire. Washington, p. 1 2. 1969. 

8, National Survey . . op. cii., p. 9. 

9, Analysis and Interpretation . . ., op. cii., p. V-4-7. 
IO.Ibid,V.|. 

1 1 , National Survey . . ., op. cit., p. 10. 

1 2. Analysis and Interpretation . . ., loc. cit. 

1 3. Greenleigh Associates^ op. cii., p. 1 8. 

14. Systems Development Corporation, job Related ABE. Vol. 1: Summary and Recommendations. Falls Church, 
Virginia, p. 15, February, 1971. 

15. Greenleigh Associates, op. cit. 

16. Witty, Pauf A. "'Guiding Principles in Reading Instruction," in Lanning and Many, op. cit., p.. 263. 
Part 4: In-Service Education 

1. Camp, James H. North Carolina ABE Evaluation 1971. pp. 26, 27, 30. 

2. St-udy of Urban Public School Adult Basic Education. (ABE in the Inner City Project.) New York: Center for Adult 
Education, Teachers College^ Columbia University. 1971. 

3. National Survey of Adult Basic Education Teachers. (ABE in the Inner City Project.) Nev^ York: Center for Adult 
Education, Teachers College, Columbia University. 1971. 

4. Knox, Alan. B. In-service Education in Adult Basic Education. Tallahassee, Florida: Research Information 
Processing Center, Department of Adult Education, Florida State University, p. 1 . 1 971 ./ 

5. ibid., p. I. 

6. Burnett, Richard W. "Basic Literacy Projects for Adults: A Reading Specialist's Comments," in Lanning, Frank W./ 
and Wesley A. >AdLny, [Us.] ^ Basic Education for the Disadvantaged Adult: Theory and Practice. Boston: Houghton 
Mifflin Company, p. 240. 1966. 

7. Ibid., p. 243. 

S. National Survey .... o[). c\i., p. 8. 

9. Selected Action Implications for Urban ABE Directors. New York: Center for Adult Education, Teachers College, 
Columbia University, 1971, p. 32. 

Part 5: Instruction 

1. Ulmer, Curtis. Teaching the Disadvantaged Adult. Washington, D.C.: National Association for Public School Adult 
Education. 1969. 

2. Ulmer, Curtis, and Din nan, James. Teaching Reading to the Disadvantaged Adu/t. Englewood Cliffs, New jersey: 
Prentice-Hall. 1971. 
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3. iMangano, Joseph A., (Ed.), Stratecjies for Adult Bask: Education. Perspectives in Reading, II. Newark, Delaware: 
Inlernational Reading Association. 1969. 

^1. LalTey, James L., ei .il. Research on Reading from "Research in Educationr' Supplement I. IZI^IC/CRIliI^ Reading 
Review Series, Bibliograpy 28. Indiana University. IZDRS Price MF 50.65. HC $13.16. ED 039 391. 317 pages. 
June, 1970. 

5. Kreiilow, Burton W. Basic E.xplorations in Adult Re-Education. A Terminal Report from ihe Aduli Re-Education 
Proieci. Madison, Wisconsin: Research and Development Center for Cognitive Learning, University of Wisconsin. 
I'heoretical Paper No. 25 (ED 042 991 ; EDRS Price: MF $0.65, HC $3.29), April 1970, pages 15. 

6. Sherk, |ohn K., |r. and Mocker, Donald W. "Guidelines for the Development of a Learning Center in ABE." /Ic^t/// 
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12. Systems Development Corporation, op. cit., p. 15. 

!3. Hayes, Ann, Nancy Lighthaii, and Dan Lupton. "Methods," in Lanning, Frank W., and Wesley A. Many (Eds.). 
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1 966. 

14. Information and Training Services and U. S. Office of Education. "Educationally Deficient Adults," in Lanning and 
-Many, op. cit., p. 402. . 
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APPENDIX C 



Adapting Manual for ABE/Model Cities Joint Programs 

A\llhoiigh this manual wns not developed specirically for the evaluation of ABIi/Model Cities joint programs (funded 
under Section 309 of the Adult Education Act), it can be readily adapted for such use. Some suggestions for adaptation 
are presented in this section. 

The instruments in this manual were designed to collect two different kinds of data: data on intended practice and 
.data on current practice. Most items on intended practice are located in the Administrative Staff Interview Guide. 

In evaluating ABE/Model Cities (oint programs, data about intended practice should be collected from Model Cities 
administrators as well as ABE administrators. Both parties should be interviewed with the help of the Administrative 
.Staff Interview Guide. The responses io the interviews should thv^n be compared lo identify differences between the 
piogram intentions of the ABE and Model Cities administrators. The evaluator should consider the following questions: 

( 1 ) How great are the differences in intentions? Sizable differences indicate. potential areas of conflict. 

(2) Have differences in intention made it difficult for ABE and Model Cities to cooperate? What mechanisms have 
been established to reconcile differences in intention? 

Once data on intended practice have been collected from both parties and disciepancies noted, current practice data 
should be collected as indicated in the manual. Data on current practice should then be compared with data on 
intended practice. Evaluators should consider the following set of questions at this point: 

If there are discrepancies between the program intentions of ABE and ol Model Cities, to what extent does current 

(actual) practice reflect tliesc discrepancies? 

(1) Have the two agencies resolved their differences? If so, in what ways? 

(2) Have discrepancies in intentions produced conflict which has adveisely affected current practice? 

(3) Have the program intentions of either agency prevailed over the other? If so, how has this affected the joint 
program? 

Data on current practice arc collected mainly from questionnaires administered to the ABE director and to ABE 
teachers. The Director Questionnaire should also be administered to the ABE director's counterpart in Model Cities. 
This will permit a comparison between how the ABE director perceives current (actual) practice and how the Model 
Cities director perceives it. Discrepancies in perception will lead the evaluator to further data analysis and to judgments 
about source credibility. It will help to compare discrepant perceptions with various objective data such as the Program 
Statistics Form. The following, questions might be considered at this stage: 

(1) How do different perceptions of current practice compare with any different expectations regarding intended 
practice? 

(2) Do differences in perceptions of current practice indicate a lack of communication and feedback? How can 
comnumication be improved? 

Data on current practice collected from the Teacher Questionnaire are very important. The evaluator should 
consider administering the Teacher Questionnaire to all teachers who teach in the ABE/Model Cities joint program 
regardless of which agency pays them. Data on teachers' perceptions of current practice can then be compared in a 
manner similar to the foregoing comparisons of Director Questionnaire data. 

The collaboration component (Part 111) has been designed to evaluate the sum of all collaborative relationships • 
established by ABE programs, instead of one intense relalionship such as ABE/Model Cities joint programs. For this, 
reason, the following modifications are suggested for the items in the collaboration component and in the parts of the 
instruments devoted to collaboration: 

(1) Most of the needed modifications can be accomplished by replacing the word "collaboration", in the evaluation 
items with the phrase "ABE/Model Cities joint program." For example, item 1 of the Collaboraiion section of 
Part"!! 1 reads: "Proportion of your ABE budget and of your administrative time should be and /5 allocated 
for collaboration." This wotild read: "Proportion of your ABE. budget and of your administrative time that 
should be diUd /s allocated for the ABE/Model Cities joint program.-' When the corresponding question (51) in 
the Administrative Staff Interview Guide is asked of Model Cities administrators, it should read: "What 
proportion of your Model Cities budget and administrative time should be allocated to the ABE/Model Cities 
joint program?'.' The corresponding question (60) in the Director Questionnaire shoiild be similarly reworded. 

(2) Collaboration item 10 deals with the benefits of collaboration and item 12 with the disadvantages of joint 
programs. The same format should be retained. Corresponding items in the instruments should be similarly 
modified. 
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(3) The Co-Sponsor Dntn Form enables evalualors to compare various co-sponsor relationships. The Co-Sponsor Data 
Form can be used lo: 

a. make comparisons between joint program classes conducted at different sites; 

b. compare the ABE/Model Cities joint program with other co-sponsor relationships. 

(4) The evaluator may wish to modify the Co-Sponsor Questionnaire to better reflect the characteristics of the 
specific ABE/Model Cities joint program. In this regard questions may be changed, added, or deleted. 

The goal-setting component (Part III) was designed to evaluate the process of goal-setting- for the entire ABE 
program. For the purpose of evaluating an ABE/Model Cities joint program, the evaluator may reword items so that 
they refer solely to the joint program. For example, item 1 in the Goal-Setting section reads: "Persons or groups who 
should have and currently (/o have the most influence on setting program goals and priorities." This might be changed 
to read: "Persons or groups who should have and currently (/o have the most influence on setting ABE/Model Cities 
.joint program goals and priorities." Similar changes should be made in the corresponding questions in the instruments. 

Some items on goal setting may seem irrelevant for the evaluation of ABE/Model Cities joint programs. If so, 
delete them and add others that are more relevant. I 
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